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Presented is the final evaluation report of the third 
year of a project to develop a model for providing prompt analysis of 
learning disabilities, intensive specialized teaching # support to 
parents and regular teachers, and a practicum for specialist teachers 
in California. Sections cover the following: historical background of 
the project, evaluation methodology, implementation of the model in 
the San Francisco Unified School District, conclusions, definitions 
of intervention terms, implecations, guidelines for project 
operators, staff development, and replication activities. Outlined in 
a section on the analysis of project objectives are the assessment 
tools and intervention techniques utilized, and measured outcomes 
regarding target behaviors* The bulk of the document consists of 
appendixes which include a summary of dissemination activities, 
sample workshop evaluation forms, and non -commercial materials used 
in workshops, Also appended is an evaluation report on program 
activities over 3 years relating to the following objectives! 
enhancement of behavior and/or academic skills for students with 
learning and/or behavioral disabilities; development of special 
teachers 1 skill in planning and implementing intervention for 
educationally handicapped studants and assisting other on-site staff 
in sharing the instructional responsibility; development of regular 
teachers* skills in identification, assessment, and instruction of 
students with learning disabilities; implementation of alternative 
patterns of service by support personnel; and working with 
teacher -training institutions to provide opportunities to have 
monitored practicum experiences with students, parents, and school 
staffs in pupil assessment, instruction, and consultation. (SBH) 
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FOREWORD 



This report represents the final summary of a three-year project which - 
Involved many, many people devoted to the high Ideals and concepts of the 
project, 

A brief review of the historical background of the project gives 
us the sense of determination that kept the project going In the face of many 
recorded (and unrecorded) adventures in administration of a joint district 
and State Department effort. Changes of staff at both levels; changes from 
the original concept of delivery of services to children caused by court 
rulings and district reorganization; and many other problems caused many concerns 
and adjustments to meet the problems. Through all changes the project did 
more forward and the results are here to see. 

It is not possible to thank each and every one in this short foreword 
for their unique contribution. On Page 52, we have shown the names of all 
those who contributed so much over the years, However, a few people need to be 
singled out for attention, 

Dr- Marguerite Dugger, Project Supervisor for the San Francisco 
Unified School District, and Dr, Margaret Scheffelln, State Department of 
Education and .Project Director during 1971-72 and 1972-73, were the inspira- 
tional team who designed the original project and gathered together the staff 
who provided the sinews of strength that every project requires, 

Acknowledgement is made for the leadership provided for the first two 
years by Joyce Kohfeldt and then Jane Anderson for the final evaluation year. 

This last year of the project has not been easy! The first two 
years of the project were the formative and experimental years. Much of the 
materials used, many of the procedures of pupil assessment and eu^c tional 
Intervention had to be refined, and teacher training procedures examined. Not 
everything turned out perfect* However, learning was taking place and the final 
evaluation can set the stage for? future efforts and giving guidance to anyone 
undertaking to replicate the work that has gone on In the project, 

7 

Because of the need to get organized data, the final evaluation 
report was contracted for through the State Department of Education, Office 
of Program Planning, who in turn obtained the services of Dr. Theodore Alper 
and Thomas Whalen, Their report has been included as Appendix H, 

A final word of acknowledgement for the fine support given me by 
the staff during the 1973-74 year. Their diligence and concern has been grate- 
fully noted, And to Mrs, Edna Bowen , a special acknowledgement. While all of 
us "fly about", she manages to keep -all 'the bits and pieces together in San 
Francisco, while maintaining the calm secretarial attitude. Her efforts have 
"put the report together", and we all thank her. 



Charles W, Keaster 
Project Director 
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ABSTRACT OF THIRD YEAR PROJECT 

The objectives of the third year project wares (1) Enhancement 
of pupils 1 behavior, self ^concept, and academic skills? (2) Development 
of EH teachers 1 skills in planning and implementing interventions, and 
assisting others in sharing instructional responsibilities: (3) Develop- 
ment of regular teachers 1 skills in identifications, assessment and in- 
struction of pupils with learning difficulties s (4) Implementing alterna- 
tive patterns of service by support personnel to pupils and teachers t 
and (5) Working with universities to provide opportunities for teachers 
to have monitored practicum experiences, 

The purpose of the third year grant was to (1) continue with 
refinement of the model as developed in the first two years i (2) design 
and implement the evaluation methodology % and (3) extend replication 
activities. 

The evaluation component of the project centered on: (1) direct 
service to pupils with learning disabilities i (2) involvement of special 
education and regular teachers, and support personnel in educational 
interventions s and (3) e^anded university involvement in practicum 
experiences* 

Dissemination activities included planned presentations, demon- 
strations and discussions with key leadership groups involved with learn- 
ing disabled pupils, 

Project methodology included direct measurement of the degree 
to which each of the five project objectives had been achieved. Sources 
of data for analysis were interviews, records, observation of techniques 
and activities, and questionnaires* 
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Among the outcomes of the evaluation component the follow- 
ing illustrate areas of changes 

1. There were significant positive ehangei in problem 
and work*related behaviors at the primary level 

2. Pew significant changes in self-concept occurred 

3. There was significant improvement in number 

, recognition and math computation skills at the 
primary and intermediate level. There was 
significant improvement in alphabet and word 
recognition skills at all levels. 
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HISTORICAL BACKGROUND 1971-1974 

California wag awarded one of eight federal grants to states 
in 1971 for developing and operating Child Service Demonstration Project! 
under Public Law 91-230, Title VI, Education of the Handicapped Aot, 
Part 0- * Specific Learning Disabilities, The State Department of Educa* 
tion received a grant of $125,260 for the period from July 1971 through 
June 1973* An additional $70,000 was approved for July 1973 through 
June 1974 to develop the program evaluation eomponent and to determine 
the effectiveness of the five program objectives. 

The original project proposed to improve services for children 
with learning disabilities, The model was developed within the framework 

of the California State Program for Educationally Handicapped pupils, 

i 

Concurrent with direct serviee to children, the model offered on-site 
in-service for regular teachers, support staff, administratora , and 
special teacher in EH Glasses* As a research and development effort, 
the project established a design for public school services, evaluated 
the delivery service, and assisted other districts with dissemination 
and replication of validated components, 

The project was directed by consultants assigned State respons- 
ibilities for the EH Program from the State Department of Education, 
Bureau for Mentally Exceptional Children* The operation model, developed 
co- jointly with the San Francisco Unified School District, was managed 
by the on-site Project Head with support from the District M Supervisor, 

Impetus for the proposal came as a result of difficulties 
noted in large districts serving LP pupils within the State Program for 
Learning Disabilities* (program for the Educationally Handicapped), 
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Some of the specific problems weres 

1* A time lag between referral of a pupil with problems 
and direct classroom assistance for pupil and teacher 

2* Limitation in teachers 1 ability to identify and pro- 
vide for minimal to moderate learning disorders/ 
Limited in-service programs for regular classroom 
teachers to acquire specific knowledge concerning 
learning disabilities 

3* Insufficient support staff for follow-up because of 
processing large numbers of inappropriate referrals 

4, lophasis on psychological tests for eligibility de- 
cisions, with limited application for instructional 
decisions 

5* The required medical examination resisted^ some 

parents, making screening and placement impossible to 
complete 

6* Need for EH teacher in-service to assure coH^ettmce 

The proposed model, preserving much of the standard EH opera- 
tions, incorporated concepts from an earlier Federal ESEA VI-A (later 
changed to BSia Title VI-B) project for" in-service in the San Francisco 
Unified School District during the summers from I968 through 1970. As 
the training program shifted from theory to actual demonstration and 
practice, teachers gained in skills and confidence. The District sought 
to maintain a similar plan for staff development during the academic year 
but lacked funds and personnel, The proposed project made it 

possible to carry on staff development activities similar to those of 
the earlier VJ,b project, but available during the regular school year. 
The Child Service Model for California emphasized! 

1« Coordination with general education 

2. Comprehensive educational assessment of pupils 

3* Excellence of instruction of regular and special teachers 

4* Dissemination and replication activities 
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Innovative components proposed to include a r *source teacher 
specialist, and an intensive diagnostic center (laboratory)* The labora- 
tory also served as a training resource for teachers. Other in-service 
was concentrated at the site of the referral in targeted schools. 

Procedures differed from the standard EH Program in these waysi 

1, The resource specialist teacher responded initially to 
the regular teacher's request for help with a pupil 

2, Preliminary problem definition focused on the interaction 
of pupil and classroom 

3, Immediate educational interventions were developed by 
the referring teacher! pupil and VT-0 staff for temporary 
help 

4* Additional clinical studies were requested as needed 

5* The diagnostic center was used only when more intensive 
study or educational recommendations were indicated 

6. Conferences held on-site on a regular basis maintained 
the commitment of staff to a pupil 

7* Substitutes or VT-0 staff conducted classes to permit 
teachers to participate in in-service activities 

8* Extensive data gathering devices and pi ocedures were 
developed in 1972*73 

Finding was shared by local, state, and federal sources* 
Federal funds covered salaries of the San Francisco Unified School Dis- 
trict Project Head and Secretary, the evaluation component, consultants, 
and substitutes. The State provided usual foundation support for pupils 
and special education fund apportionment according to a daily attendance 
in various EH Program types* Pupils served in regular classes were not 
labeled EH and were not claimed for special education State reirabursemant* 

The local District maintained its previous financial effort by 
providing salaries for teachers, administrators, support staff, facilities 
materials, transportation^ and the EH local supervision* 
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The Leadership Training Institute for Learning Disabilities 
at the University of Arizona provided additional services to California's 
Child Service Project. 

The primary task during the first year was to determine what 
specif ioally needed to be dona to achieve the proposed objectives, Dur- 
ing the second year, the staff formalized procedures for getting the job 
done, The final year focused on more efficient delivery of services and 
executing *b e evaluation design for the total program. 

Certain conditions within the San Francisco Schools prevented 
full implementation of the model as originally proposed. A court order in 
1971 introduced integration virtually overnight - distributing elementary 
minority pupils among faculties unprepared for major differences in culture, 
communications, and behavior patterns of these newly assigned pupils. 
Until teachers were more skilled in general classroom management under 
these new conditions, they had, predictably, little energy left for a few 
pupils with specific learning difficulties. Total adjustment was needed at 
the elementary level because of elementary reorganization from a K-6 plan 
to K-3 and 4-6 in separate schools. 

The Title VI-G diagnostic centers (laboratories) were phased 
out at the end of the first year. It became apparent that placing pupils 
in the segregated laboratories, aight delay the development of more complete 
cooperation between general and special education, In operation, the 
centers tended to reinforce the entrenched concept that special education 
should supplant (i,e. remove) rather. than supplement regular education for 
most pupils. Thus the model was revised, replacing the laboratories by 
increased resource teacher service and by general workshops on diagnostic 
and remedial techniques , 12 
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The pro jeot proposed the following objectives for the second 

year, representing a refinement of the first year's objectives: 

1, To enhance behavior, self-concept, and academic aehive- 
ment of pupils with learning/behavioral^ disorders 

2* To develop skills of EH teachers in planning and imple- 
menting interventions for EH pupils; assisting other 
on-site staff in sharing instructional responsibilities 

.3. To develop alternative patterns of service to pupils 
and teachers by support personnel (principals, social 
workers , psychologists ) 

4, To develop slcills of regular classroom teachers in 
identifying, assessing, and instructing pupils with 
learning problems 

5. To provide practicum experiences for teachers in pupil 
assessment, instruction, counseling 

By the end of the second year, the staff had defined its pro- 
cedures, developed tentative instruments and forms for carrying on its 
various functions. The project staff conducted workshops which success- 
fully emphasized not only cognitive activities but also pupils 1 feelings, 
interest in learning, differences in learning styles, and response to an 
extensive range of materials. Inter-disciplinary cooperation was enhanced 
through these activities with VX-G support* Post-hoc evaluation was per- 
formed by review of data on activities and structured interviews of dis* 
trict staff by outside consultants. 

Although continuous staff , development was provided at target 
schools, a series of workshops was also developed in the second year for 
support staff, administrators, regular and special class teachers through- 
out the district. These sessions provided brief descriptions of problem 
areas such as Managing Environments, Diagnostic Tools, Language Development, 
Participants selected two of eight such topics for in-depth study* . The 
workshops continued in the third year with on-site demonstrations described 
in the third year report* 

13 



In addition to increasing skills of individual participants, 
the 1 workshops resulted in developing effective working relationships 
between special and general education. 

With procedures stabilized, the Title VI-G staff focused on 
documenting and evaluating its operations in the third year, assisted by 
an outside professional evaluation team. Results of the evaluations are 
summarized later in this report. 

The projtot served as a model which could be replicated with 
modifications in the Bay Area and elsewhere in the State and nation, 
Adaptations have been, made in Oakland, Charter Oaks, Oxnard, Badlands, 
Hacienda La Puente, Rowlands, Marin County, 
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THIRD YEAR OF THE PROJECT 

The over-all purpose of the project was to develop a model for 
providing prompt analysis of learning disabilities, intensive specialized 
teaching * support to parents and regular teachers , and a praotioum for 
specialist teachers . 

There were three components of the third year grant: 
Continued model refinement and implementation 
Ejqpansion of evaluation methodology 
Extension of replication activities 
The full time projeot staff included: 
1 Project Head 
5 Project Research Teachers 
1 Secretary 

Project supervision was provided by the San Francisco Supervisor 
for Educationally Handicapped Program and by the Project Director who is a 
consultant from the Division of Special Education* State Department of 
Education* 

OONTXNIJBD MODEL REFINEMENT 

There were five basic objectives in the third year continuation 

plan? 

1*0 Enhancement of behavior, self-concept and academic areas 
for pupils with learning and/or behavior disabilities 

2*0 Development of EH teachers 1 skills in planning and imple- 
menting interventions for EH pupils, and in assisting 
other on-site staff in sharing the instructional 
responsibilities 

3*0 Development of regular teachers* skills in the identifi* 
cation, assessment and instruction of pupils with 
learning difficulties 

# 

15 
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4,0 Implementing alternative patterns of service by support 

personnel (principals, social workers, school psychologists, 
etc,) to pupils and teachers 

5*0 Working with teacher training institutions to provide 
opportunities for teachers (pre-service and ln*.servioe) 
to have monitored practieum e^erienoes with students t 
parents, and school staffs in pupil assessment, instruc- 
tion and consultation 

EXPANSION OF EVALUATION METHODOLOGY ' 1 V r 

The third year evaluation methodology was developed to assess 
project objectives. 

The responsibility for the third year project evaluation was 
assigned to the Evaluation and Testing Unit of the California State Depart- 
ment of Education, An evaluation framework had been developed which in- 
cluded! but is not limited tos 

a, Measurement of attainment of objectives 

b, Qualitative and quantitative determination of products 
developed by the objectives 

o, Identifieation of appropriate data collection and 
analysis methodologies 

d, A clear delineation of costs in relationship to 
outcome and benefits 



e, 



Recommendations for modification and implementation 
of project methodologies 



EgTONSION OP REPLICATION ACTIVITIES 

and teaching techniques to numerous educational agencies. In addition, 
project staff time was allocated to permit replication applicants to 
participate in project activities, 

The on*site replication districts for the third year were 

limited tos 

1* Oakland Unified School District (inneroity) Target pupils 
CUaremont Junior High ; School 7-9 16 



0y ■ 



Target pupils 
20 

20 
20 



v 2, Marin County School District (rural) 

Nioaslo School K • 8 

Lincoln School ; K* 6 

Laguna School K » 8 

A* The model in the San Francisco Unified School District 
The primary thrust of tha third year continuation plan was to 
develop and implement efficient on-site models for support of teachers and 
other personnel in the delivery of services (recognition, definition f diag- 
nosis * intervention f follow-up) to oMldrsn with learning problems in 
regular classes and in special programs for the educationally handicapped. 

The project continuation plan specifically defined the target 
population for Title VI-G services; 



* THIRD YEAR ACTIVITIES ■ . 

LOCATIONS AND PARTICIPANTS (BY PROJECT OBJECTIVE) 



Project Objectives 



San Francisco 
Unified 
School District 



Inner-City 
School t 
Districts 



Urban & Rural 
School 
Districts 



Totals 



1*0 Direct service to 



65 pupils 



33 pupils 



32 pupils 



129 pupils 



2.0 and 3.0 
service to regular 
^and EH teachers 



Target 
Teachers i 
Other 
Teachers i 



36 
75 



Target I Target ,• 1 ; % - 

Teachers J 1$ * Teachers; 16 

Other 1 Other 

Teachers i\ 55 | Teachers % 55 



68 

-"teachers 

185 

teachers 



4*0 Involvement 

of support personnel 



Principals 1 
Specialists 



12 
2k 



£.1 " 



Principals 1 6 
Specialistsi 15 



Principals » 6 
Specialists 1 15 



^Principalis 
Specialists: 



2<f 
5? 



: 5.0 Involvement of 
v teacher training 
institutions 



TOTAL TEA0E2R TRAINING INSTITUTIONS PARTICIPATING: 5 
TOTAL NUTTER PARTIC I PATIN'G COLl^OE ^STUDarrSs 200 
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The participating schools for on-site delivery in the San 
Francisco Unified School District ware as follows: 

Target pupils 
' Grade Leva! ( Screened Hi) 



1, 

2* 


Phoebe Apperson Hearst School 
Robert Louis Stevenson School 


K-3 
K-3 


3 
10 


3. 


San Miguel School 


K-3 


18 




Edison School 


4-6 


5 


5. 


Lawton School 


h .< 


6 


6. 


Mark Twain School 


4-6 


2 


7, 


Winfield Scott Sehool 


4-6 




8, 


Aptos Junior High School 


7-9 


4 


9. 


Portola Junior High School 


7-9 


6 


10. 


MeAteer High . School 


10-12 


5 


B* 


Initial procedures for delivery of 


services 




Prospective sites were selected from 






1, 


Requests for services 






2, 


Continuation of services from previous year 




3. 


Previous professional contacts 








Outcome of orientation workshops 







Since the target population was defined by the State Department 
of Education, a screening process was necessary to determine which schools 
would receive Title VJ-Q services for 1973*74, 

The screening process consisted of an initial interview with the 
school principal by the Project Head. The purposes of this interview were: 

1* Establishing rapport 

2# Assessing toe needs and the problems of that school 
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5, Defining the principalis philosophy of educating 

the pupil with learning problems 
4. Easpiaining Title VI-G and its role as a, program 

developer rather than as a crisis intervention I* * 

aerviee 

If the needs of the school matched the resources and the pro- 
ject foou§ for Title VI-G, an informal contract was formulated to define 
the responsibilities of the school and Title VX-G* 

The principal's ooamitment wasi 

I'm To support Title VI-G as a primary EH resource 

2. To designate an on-site coordinator for Title VI-G 
services 

J, To involve the staff in meeting the needs of EH pupils 

4, To continue the thrust toward developing a self- 
sustained program 

Title ¥1-0*8 eoraiitment was: 

1 * To select a Title VT-Q staff member with appropriate 
□kills to meet site needs 

2* To develop a program to meet Hi pupils needs at that 
site 

3/ To train on-site staff to meet the needs of pupils 
with learning disabilities and/or behavicr dis- 
abilities 

4* To follow through with a continuing program of 
workshops and speoialiged trainir^ in developing 
materials for individualized instruction 

5» To act as a liaison between San Francisco Unified 
School District Special Education Division and the 
school site to facilitate consistent service 

The on-site coordinator was one of the following! 

.EH teacher 

2 e Regular classroom teacher 

19 

13 r 



I 
m 



5. Social worker 

W - ' *k 

r- .JThe Title VT-Q staff member assigned to that school, together 

7 

with the coordinator, made a preliminary assessment of the needs of the 
school on one of the three Teacher Participation Request Forms (see 
£ Appendix). 
K These forma were distributed through the coordinator to staff 

members who had screened EH pupils in their classroom. Screened EH pupils 
are those who have been previously identified by the District; these pupils 
{?;.;■■..■ § may be in a regular classroom, a learning disability classroom, or a 

self-contained classroom* 

• ' :~' . ' • 

S - Target EH pupils for the project were selected from classrooms 

fer-v • • ■■ - 

^V/' where the teacher (regular or EH) expressed a willingness to make a coranit- 

pi'-; ment to Title VI*G. 

C* Objective 1*0 * Enhancement of behavior « self»coneept. and 
academic areas for pupils with learning and/or behavior 

|f : : disabilities* 



A defined assissment package was used with each target pupil to 
determine his needs in academic and behavioral areas (see ..Appendix)-. The 
information obtained from this assessment was used to develop an interven- 
tion program* 

The intervention program was carried out by a Title VI-0 staff 
member or the teacher in the classroom setting* 

The same assessment package was used following the intervention 
period to determine pupil change* 



: D» Objective 2.0 - Development of M teachers 1 skills in 

planning and implementinf intervention§ for EH pupils 
and assisting other on-site staff in sharing the 
instructional responsibilities. 
Through a series of workshops and on-site demonstrations 
EH teaehers were instructed in the administration and interpretation of 
formal and informal diagnostic tools, (see Appendix), Training followed 
in translating this information into specific long«range and short-range 
instructional activities. 

At the site level the staff worked with EH teachers in organ- 
izing the classroom environment to fit the individual needs of the pupils. 
Effective utilization of time, both in instructional planning and in pupil 
scheduling was analyzed and modified when necessary for the particular 
classroom structure. 

The Title VT-G staff examined a wide variety of oomnercial 
materials and chose those which best fit the pupils 1 assessed needs and 
the EH teachers 1 skills. Workshops and in-service training on specific 
materials were sponsored by Title VT*G. These workshops served to in- _ 
crease- the teachers 1 skills in the selection, utilization, and evaluation 
of instructional tools and techniques, 

A valuable component of the project was the provision of 
substitute release time for teaehers which enabled them to participate 
in project activity and develop professional skills. Substitutes were 
also used by the project staff in pupil assessment, interventionsy ~ 
presentations, and resource room development, 4 '" r ' v 

E. Objective ^,0 - Development of regular classroom 

teachers 9 skills in the identification, assessment and 
instruction of pupils with learning difficulties* 



The services described under Objective 2.0 were delivered to 
regular classroom teachers* In addition, Title VI-0 staff members 
assisted the regular classroom teachers in identifying early indications 
of learning difficulties with appropriate diagnostic tools* In the 
regular classroom special assistance was provided in developing individual 
programs for pupils with learning disabilities. 

Because of the move toward mainstreaming in California, the 
project emphasised broadening the scope of instructional options for 
regular classroom teachers in order that tKey^might be better able to 
respond to a wider range of pupil needs* 

P* Ob jective 4,0 - Implementation of alternative patterns 
of service by support personnel (principals, social 
workers, school psychologists, etc*) to pupils and 
teachers , 

The services described under Objectives 2,0 and 3»0 were de- 
livered to support personnel staff. 

Where possible, Title YI*0 assisted in organizing space, funds, 
materials and personnel support for the daily operation of an 1H program 
within a building* This ^consisted of developing resource rooms where 
learning disabilities were assessed, instructional techniques were de- 
monstrated, and instructional materials disseminated. 

With Title VT-G services 'on-site, the time lag between a 
request for help and the initiation of educational assistance was 
substantially reduced. 

Title VI*0 staff worked closely with ancillary personnel in 
the areas of screening, placement, admissions, demissions, and restruc- 
turing of EH units in order to match the intensity of service to the 
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intensity of needs. Title Vl-G was effective in obtaining from support 
personnel staff a L coimitment to work toward modifying the instructional 
program so that the needs of the EH pupil could be met in the regular 
classroom. Ancillary personnel were encouraged to monitor the progress 
of screened IH pupils who were not in an EH unit* so that these pupils 
might receive instructional services which could result . i^JTully imple- 
menting the mainstreaming philosophy. 

The learning team concept of shared responsibility between 
teaching and support staff was developed to provide opportunities for 
continuing communication in a learning environment. 

G. Objective 5.0 - Working with teacher training institu- 
tions to provide opportunities for teachers, (pre-service 
and in-service) to have monitored practieum experiences 
with students, parents, and school staffs in pupil aeaeis- 
roent, instruction and consultation. 
The project staff provided an opportunity for interns to 
observe a variety of educational settings and instructional techniques. 
Their training included using the project's formal and informal diagnostic 
tools and interpreting the data to establish instructional goals. They 
were given the opportunity to share their previously acquired skills with 
the classroom teacher. The interns assisted the Title staff in 

implementing the intervention program for individual pupils. The workshops 
presented or sponsored by Title VT-G provided opportunities for their 
educational growth* 
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CONCLUSigM ■ ■ . V 

Title Vl*o was designed as a research project to develop a model 
for effective service to EH pupils. The model delivery program which had 
been develops and implemented during the first two years and refined and 
evaluated ±n the third year project proved to be a feasible and efficient 
delivery 3 y^ws at all grade levels. The key to the success of the project 
was the on-fit© delivery system. The district has made a conmitment to a 
continuation of on-site service as demonstrated by the Title VT-G model, 
The Provision for trained substitutes contributed to the success^ 
of the project by releasing teachers for professional development and 
implementing Project activities* 

Titl a VI^q w a also instrumental in obtaining a commitment from 
general eduo^Aan to share the responsibility for the education of the 
pupil with learning disabilities (EH) so that he might function in a ■. 
regular classroom with his peers. 

The effectiveness of the Title VI-G project was due in large 
part to its woeptance as a non- threatening neutral resource to the 
local school staff. The Title VI staff had a wide background in regular 
and special education, experience in working with support personnel, and 
skills which facilitated the development of an on-site working team, 
The most effective school on-site team was composed of a special educa- 
tion teacher^ ft. Regular teacher, a counselor and/or a social worker, and 
the principal I this coordinated the school resources to meet the 
individual n # ed s of pupils with learning disabilities, 

Title VI^Q has Provided Pupil Personnel Services (social workers, 
counselors, piyehologiflta) with a vehicle for entrance into a classroom,, 
Pupil Pei-sonijel Services provided an atmosphere of support for Title VT-G 
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staff in their acoeptanoa of the model delivery system; this contributed 
i to a mutual Sharif of resourofrs in our target, schools through workshops 
and in-service training. 

During 1974-75 Special Eduoation, Pupil Personnel and General 
Education staff will monitor the degree of continuing team cooperation at 
the school site level. This monitoring effort will reveal the effective- 
ness of the collaboration between speoiai and general education staff 
working with San Francisco Unified School District children as teams in 
order to improve educational programs. 

The Assistant Superintendent of the Division of Speoiai Education 
endorsed the philosophy of the model project through administrative 
recognition and included the Project Head in the Special Education Council 
recognizing the project as a vital component of the division. The San 
Francisco Unified Sehodi District Supervisor of the EB program was an 
integral part of the project* With the support of the administrative 
staff the project was able to make great strides in the district* Among 
Title VT-G*s accomplishments was the establishment of a resource room 
in the district's regular education Teacher Learning Center. Th^s com- 
bined the resources and in-service training of both regular and special 
■education at one central location which was one of the major ^oves 
toward fulfilling the objectives of the California Master Plan for 
Special Education* 

The Project Director at the State level provided on-site service 
which strengthened the model project's primary focus - "on-site delivery 
of service at all levels." The Project Director brought information 
directly to the project staff relative to the implementation of the Master 
Plan. In this way the staff was able to implement the philosophy of the 
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Master Plan at their target schools , 

The Leadership Trailing Institute, nationally recognized in the 
field of learning disabilities presented the current findings in the 
field to the administration and teaching staff of the San Francisco 
Unified School District. These contributions, through workshops and 
consultation, gave national status to the local project- 
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DEFINITION OP BnilRYBNTIQN TEEMS 



1* TASK ANALYSIS - defining problem 

Process of defining the problem resulting in a specific definition. 
A framework for organising the structure of the classroom materials 
content, and rewards in efforts to effect meaningful transactions 
between teacher and child* 

2, BEHAVIOR ANALYSIS - defining problem 

Process of defining the problem objectively resulting in a specific 
definition* Level of behavior is observed and recorded, A method 
or procedure is designed to improve or remediate the child 1 s per- 
formance* 

3* FORMAL ASSESSMENT - use of standardised ins truments/standard pro- 
tocol (WRAT). Shows the range of performance within a designated 
group, based on "grade" placement* Standardisation baaed on using 
a "normal 11 population, 

k* INFORMAL ASSESSMENT * use of non-standardiged instruments or 
techniques with variable protocols \ including observation and 
measurement of number intensity and frequency of purposeful and 
non-purposeful pupil behavior in the classroom* 

5. ACADEMIC OBJECTIVES - translate diagnostic information and pupil 
progress into specific long-range and short-range instructional 
activities i by adapting space, time escpectations, quantity of 
assignments* type of instructional approach used and amount and 
type of teacher reinforcement. Individual prescription formulated 
between staff and teacher to reflect pupil need discovered in 
assessment* 

6. BEHAVIOR OBJECTIVE * translate diagnostic information and pupil 
progress into specific long-range and short-range behavior enhanc* * 
ing activities by adapting space , time expectations, type of 
instructional approach, type of interpersonal approach and amount 
of teacher reinforcement* Individual prescription formulated 
between staff and teacher to reflect pupil need discovered in 
assessment. 

7. PROFESSIONAL SUPPORT PlffiSQNNmi * implementation of alternative 
patterns of service by support personnel 

a* providing general and specific staff development in re- 
lation to learning disabilities and their remediation 

b. matching severity of student needs to the amount, fre- 
quency, duration and number of services of different 
people required 

o. reducing the time lag between parent or school personnel 
request for help and the initiation of educational 
intervention 

d* obtaining educational assessment data which will result 
in changes in .the instructional program 
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8, MANAGEMENT OP 1NVIROJMEOT - organization of space, time, materials, 
and types, of instruction to fit learning strengths of pupils. 

Such management might include learning centers, flexible scheduling, 
individualized instruction, peer tutoring, etc, 

9. ^l^UALIZINO msrauOTIONAL TECfflflQUES to assist learning dis- 
ability students by adapting space, time expectations, quantity of 
assignments 9 type of instructional approach used and mount and 
type of teacher reinforcement, 

10, INDIVIOTALIZDIG EMttS to assist learning disability students by 
adapting quantity of assignments and type of instructional materials 
used to the students specific disabilities, 

11, CONTRACTS 

- written - the student and teacher in written form determine the 

time and content for a given learning activity. See 
non^ooamereial materials appendix* 

- oral * toe student and teacher, orally, determine the time 

allotment and content for a given learning activity, 

12* LEARNTOG OpTERS Df CLASSROOM - providi^ materials, information 
and patterns for individualization within a regular classroom 
setting. Stations are established for the activities followed in 
the Center pattern. For a diagram see the nori-oonmeroial materials 
appendix* 

13* TITLE VI*G - Ifeterials Dissemination Center 

Resources available to teachers to augment existing on-site instruc- 
tional materials , EH teachers may borrow materials , use them in 
the classroom and become more selective in the types of purchases 
they determine. 

14, PROJECT STAFF raVEWHraiT - Staf f VI increasing their knowledge of 
learning disabilities in general and patterns for individualization 
within a regular classroom setting and utilizing this tanowledge 
in the context of their resource Work* 

15* DEMONSTRATION TEACHING - on-site. The Title VI staff member takes 
the teacher *s student group and conducts a lesson or activity, 
emphasizing the desired concept, 

16, WOiUC^Gijy (8 hours or less without credit) 

Group activities planned for teachers or other staff members, 
emphasizing skills concepts or activities for teachers and pupils, 

17* BJ-3EIVICE TRADUBG - 7 hours or more intensive study in a given 
area with in-service credit afforded the participants by the 
school district, 

18, PARENT 2"^raiA^2^NT - Any parent contact by Title VI staff or 
teacher: regarding academies, behavior, or attitudes, 

19- VIDEO TAPING • Title VI staff taped (filmed) the teacher in 
activities emphasizing positive behavior. 
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maxBia of the project objectives 

Fro/Sect Objective No * I s 

Enhancement of behavior, self-concept, and academic areas for pupils with 
learning disabilities. 

Objective 1.1 i What are the changes in the number, intensity and 
frequency of purposeful and non-purposeful pupil 
behaviors in the classroom? 
Asswssment Tools Interventions 
Teacher Participation Request Behavior analysis 

Student Behavior Referral Informal assessments 

Pupil Observation Form Behavioral objective 

(high frequency behavior) 

Pupil Observation Form Behavioral objective 

(low frequency behavior) 

Observation/variable protocol Workshops - Video-taping 

Outcomes 

The Student Behavior Referral Form was the instrument used to 
measure changes in behavior. Teachers recorded their subjective evalua- 
tions of target pupils in the areas of problem behavior, work-related 
behavior and at the academic level. 

The teachers 1 assessment showed that more significant positive 
changes in behavior appeared in primary pupils than in intermediate or 
secondary pupils. The significant improvement in primary pupil problem 
behavior occurred in such items as running around the room, complaining, 
temper tantrums and fighting Improvement in work-related behavior of 
primary pupils occurred in working independently, attempting to do 
difficult work, taking pride in work, and the ability to organise 
materials and work. 



Objective l.g g What are the changes in pupil self^concept (pupil) 

attitude toward - self | school and learning; 

I 

teachers f other school staff?) J 
Assesignent Tools ? Inverventions 

Self-concept Inventor Behavior analysis 

Informal assessment 
Behavior objective 
Workshops 

& *. i (behavioral 
Contrasts ) , , 
■ * (academic 

Staff contacts specific to this objective 353 

Workshop contacts specific to this objective 64 

Outcomes 

Few measurably signif leant changes in seif**eonoept ooeured in 
target pupils as indicated by the Self-concept Inventory developed by 
Title VI-G staff* The design of a reliable instrument for the measure- 
ment of self ^concept has been a difficult research problem. However, 
the information gained from the Title VI-G assessment pinpointed prob- 
lem areas in target pupils and gave direction for intervention by 
staff members. The instrument also provided valuable insights f or 
teachers, ancillary staff and parents* 

Objective l,p s What are the changes in pupil academic per 
formanee? 

Assessment Tools Interventions 

Teacher rating of pupil academic Task analysis 

performance 

Work sample Formal assessment 



Assessment Tools Interventions 

WHAT Informal assessment 

Rated assessment (math) (reading) Academic objectives 

Gilmore Oral Retfding Test Academic objectives 

Management of environment 

Individualizing instructional 
techniques 

Individualising materials 
Contracts 
Learning Centers 
Demonstration teaching 

Staff contacts specific to this objective 417 

Workshop contacts specific to this objective 104 

Outcomes 

As measured by a standardized instrifflnenti significant changes 
occurred in word recognition skills and math computation at all levels* 
Significant improvement in spelling occurred at the primary and inter- 
mediate levels* 

Title VI-G staff also developed two informal assessment tools to 
measure academic growthf Rated Assessment * Mate, and Rated Assessment * 
Reading. 

The Rated Assessment - Math ^ indicated signif leant i^rovement 
in number recognition at the primary and intermediate levels * Primary 
pupils improved in set recognition and simple subtraction skills! inter- 
\ mediate pupils improved in 2 digit addition (carrying) and 2 digit 
subtraction (borrowing) skills* 

The Rated Asssessment - Reading « indicated significant improvement 
in manuscript alphabet recognition, and mixed vowel word reading at all 
levels. 3 | 
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Oral para^aph reading as measured by the Gilmore showed no 
significant change at ^ level. 

The teacher's subjective analysis of pupil academic progress 
as indicated by the Student Behavior Referral Form relucted minimal 
aoademio progress in target IH pupils* 

Project Objective No* 2 i 

Development of EH teachers* skills in planning and implementing inters 
vention for SI pupils and assisting other on-site staff in sharing the 
instructional responsibility* 

Objective g*ls Translate 'diagnostic information and pupil 



progress into specific long-range (monthly) and 
short-range (daily) instructional activities. 



Assessment Tools 



Interventions 



Staff Competency Rating of IH Teachers* Task analysis 
( ^valuators Form ) 




Intervention Checklist for Special Individualizing instructional 

Teachers (Evaluators Form) techniques 



Teacher Participation Request Academic objectives 



Behavior Referral Form 



Behavior objectives 



WRAT 



Individualizing materials 



Self-concept Inventory 



Contracts 



Rated Assessment (Math-Reading) 



Title VX-Q Materials 
Dissemination Center 



Slingerland 



Markoff Informal Assessment 



Workshops 



Modality Inventory 



In-service training 



ITPA 
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Assessment Toole 



Interventions 



Santa Clara Development Inventory 
Modality Inventory 
Ob b ervatl on/variable protocol 
Work Samples 

Staff contacts specific to this objective 135 
Workshop contacts specific to this objective 19 

Outcomes 

A series of workshops and on-site demonstrations were offered to 
EH teachers to instruct them in the administration and use of a number 
of assessment tools. The information gained from the assessment tools 
provided a basis for Title VI-G staff members and BE teachers in design- 
ing long and short-range intervention programs and activities for pupils 
with learning disabilities* 

The intervention Checklist (ivaluators Form) indicated that EH 
teachers found the Title VI-0 developed Rated Assessment and Self-concept 
Inventory to be of great value in providing information about specific 
needs of EH pupils, 

Objective 2*2 s Organizing space, time, materia" 1 r*, and type of 



instruction to fit the learning strengths of 



the pupils* 



Assessment Tools 



Interventions 



Intervention Checklist for Special 
Teachers (Evaluation Form) 



Behavior analysis 



Formal assessment 



Teacher Participation Request 



Academic objectives 



Behavior Referral Form 



Management of environment 



WRAT 
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Assessmen t Tools Inte^entions 

Self-concept Inventory Individualizing instructional 

techniques 

Rated Assessment (Math-Reading) 

Individualizing instructional 
Sllngerland materials 

Markoff Infernal Assessment Learning Centers 

Modality Inventory Title VI-G Materials Dissemina- 

tion Center 

ITFA 

Workshops 

Santa Cl^rs Development Inventory 

In-service training 

Work Samples 

Staff contacts specific to this objective 173 
Workshop oontaots specific to this objective 
Outcomes 

At the site level Title VI-0 staff isnbars worked with m classroom 
teachers to organize learning centers and provide for individualized in- 
struction for pupils with learning disabilities ♦ An inttvidualized progr^i 
for an mi pupil was designed after assessing his learning strengths and 
weaknesses, using several of "tee assessment tools listed under Objective 2* 
The selection of the assessment tools depended upon the needs of the pupil 
and the skills of the VI*0 staff person and m teacher, 

Title VI-Q staff helped the HI teacher to organize classroom time 
for an effective instructional program and efficient pupil scheduling. 

Materials dissemination from the Title VI-0 Resource Center, and 
workshops in toe use of individualized programs and materials 

were a large component of Title VI-G service* The EH teachers 1 skills in 
selecting and evaluating appropriate commercial and teacher-made materials 
were developed by workshops and on-site training, 
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On the Checklist of Interventions (Evaluators Pom) Wi teachers 

indicated wide acceptance and use of the Title VI«*G Resource Center. 

Objective 2,3 s Mobilize other school staff in planning and 

implementing a coordinated instructional 

program for pupils served by various teaohers* 

Assessment Tools Interventions 

Interview questionnaire for regular 
class teachers (©valuators Worm) 

Shared Responsibility Packet 

Intervention Checklist for Special 
Teachers (Valuators Form) 

Teacher Participation Request 

WRAT 

Self -concept Inventory 
Bated Assessment (Ma threading) 
Slingerland 

Markoff Informal Assessment 
Modality Inventory 
ITPA 

Santa Clara Development Inventory 
Modality Inventory 
Work samples 
Staff contacts specific to this objective 115 
Workshop contacts specific to this objective 36 
Outcomes 

Title VI»(# attempted to develop the EH teacher f s skills as a re- 
source person for the entire school staff so that the needs of the EH 
pupil served by several teachers could be met more effectively* 
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Joint meeting with regular 
staff and EH teachers 

Task analysis 

Behavior analysis 
Informal assessment 

Academic objective 

Behavior objective 

Individualized instructional 
techniques 

Individualizing instructional 
materials 

Workshops 

In-service training 



In some target school the resource room served as a demonstration 
center for regular and 1H teachers. 

The team approach to meeting the needs of the pupil with learning 
disabilities was developed and emphasized in a series of staff meetings, 
workshops, and conferences* 

Objective 3*4. 8 Provide information for general school staff re- 
lated to (a) learning disabilities in general and 
(b) patterns for individualization within a 
regular classroom setting* 



Assessment Tools 
Teacher Participation Request 
WHAT 

Self -concept Inventory 

Rated Assessment (Math-Reading ) 

Slingerland 

Markoff Informal Assessment 
Modality Inventory 
ITPA 

Santa Clara Development Inventory 
Work samples 



Intervantions 

Formal Assessment 

Informal assessment 

Academic objectives 

Management of environment 

Individualizing instructional 
techniques 

Individualizing instructional 
materials 



Learning Centers 
Title VI-0 materials 
Dissemination Center 
----- Project Staff Development 

Demonstration Teaching 
Workshops 

In-service training 
Staff contacts specific to this objective 91 
Workshop contacts specific to this objective 
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Outcome a 

All of the workshops on learning disabilities given or sponsored 
by Title VI-0 ware offered to the general staff of target schools. With 
the move toward the mainstreaming concept in California, the on-site 
Hi teacher has become an important resource to his school* 
Project Objective No, 

Development of regular classroom teachers 1 skills in the identification, 
assessment and instruction of pupils with learning disabilities* 
Objective 3,1 g Identify early indications of learning 
disabilities. 

Assessment Tools Interventions 1 

Task analysis 

Rated Assessment (Math-Reading) Behavior analysis 

Self-concept Inventory Formal assessment 

Markoff Informal Inventory Informal assessment 

Slingerland 
Work samples 

Observation (Formal and Informal) 

Staff contacts specific to this objective l6l 

Workshop contacts specific to this objective 2k 

Outcomes 

Title VI-G attempted to give regular teachers proficiency in the 
use of a smalls .battery of assessment instruments which could be used in 
the regular classroom, Regular teachers were given workshops and on-site 
training in the administration of these instruments and the interpretation 
of data obtained from their use. 
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Objective 3,2 1 Use diagnostic information in planning an 
individual student's program* 



Assessment Tools I nterventions 

WHAT Task analysis 

Rated Assessment (Math-Reading) Behavior analysis 

Self-concept Inventory - Formal assessment 

Markoff Informal Inventory Informal assessment 

S lingerland Academic objectives 

Work samples Behavior objectives 
Observation (Formal and Informal) 
Staff contacts specif io to this objective 135 



Workshop contacts specific to this objective 20 
Outcomes : 

Regular teachers, along with EH teachers f were given on-site train- 
ing and workshops in translating the information gained from toe above 
listed assessment tools into specific long and short-range instructional 
programs to meet the needs of individual students with learning disabiliti 
Objective 3»3 s Select and with monitored practice, administer 
informal assessment measures with due regard to 
each pupil's cultural and linguistic experiences* 
Assessment Tools Interventions 

Competency Rating for Regular Teachers Informal Assessment 
(Evaluator's Form) 

Workshops 

Self-Rating Competency 
(Evaluator f s Form) 

Santa Clara Inventory Developmental Task 
Self-concept Inventory 

Staff contacts specific to this objective 130 
Workshop contacts specific to this objeot^ve 28 
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Out come a: 

Regular classroom teachers along with EH teachers were given train- 
ing in utilizing and interpreting the informal assessment tools, The 
data from the assessments were used in individualizing programs! taking 
into consideration pupils cultural and linguistic eacperlenee* 

Objective ~*>.kt Adjust the classroom environment to assist learn- 
ing disability students by adapting space, time 
escpeotations, quantity of assignments, type of 
instructional approach used and amount and type 
of teacher reinforcement. 
Assessment Tools Interventions 
WHAT Task analysis 

Rated Assessment (Math-Reading} Informal assessment 

Self-concept Inventory Academic objectives 

Markoff Informal Inventory Behavior objectives 

Slingerland Individualizing materials 

Work samples Learning Centers 

Observation (Formal and Informal) Demonstration teaching 

Workshops 

Staff contacts specific to this objective 16? 
Workshop contacts specific to this objective 55 
Outcomes : 

At the site level, Title VI-0 staff members worked with regular 
teachers to organise learning centers and provide for individualized 
instruction for pupils with learning disabilities* An individualized 
program for an EH pupil in the regular classroom was designed after 
assessing his learning strengths and weaknesses using the tools listed 
above, 39 



Objective "5^ 1 Create and una a wide array of intruetional 
options • 



Aaseaament Tools 

Checklist of Interventions 
(Evaluatdr's Form) 

WHAT 

Rated Assessment (Math-Reading)-- - 
Self-concept Inventory 
Markof f Informal Inventory 
Slingerland 
Work Samples 

Observation (Formal and Informal) 



Interventions 

Task analysis 

Informal Assessment 

Academic objeotivea 

Behavior objeotivea 

Individualizing instructional 
techniques 

Individualizing materials 

Learning Centers 

Title VI-G materials 
Dissemination Center 

/ Demonstration teaching 
workshops 

Staff contacts specif io to this objective 191 
Workshop contaeta specific to this objective 62 
Outcomes t 

With the move toward the mair streaming concept in California, the 
regular classroom teacher must assume an increasing share of the respons- 
ibility far meeting the needs of EH pupils * Title VI-G has attempted to 
provide the opportunity for the regular teacher to develop a wide range 
of instructional tehniques through workshops t on-site training and 
materials from the Title VI-G Materials Dissemination Center » 

The Intervention Checklist (Evaluator f s form) indicated wide use of 
Title VI^G-introdueed materials by regular teachers, 

Objective ^»6; Monitor effectiveness of instructional interventions 
based on student interest and achievement* 
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Assessment Tools 
WRAT . 

*Rate<i As s a s sment (Math-Reading ) 
ailmore 

7--. • - ,.• .'. - : : . . . ■■• ■■■■■ .. ■ . ■ • ,. • .•• 

„ . : ; . 

- Student - Behavior Referral Form 



|l^\--Workt Sarnies;; 



Observation (Formal and Informal) 



Interventions 
Behavior analysis 
^li^ormed" as ses sment 
Academic objectives 
Behavior objectives 
Iridivldualiiii^ mat^WlJ.s; 
Learning Centers 
Demonstration teaching 



Workshops 



Staff contacts specific to this objective l8o 
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Workshop contacts specific to this objective 55 
Outcomes s . '. - : ->>' •: ; .>' ,:i '^^ ; ;;-;V ; :f-^- > ;o\.^\- r v ' w\ 

^ Title VI-G staff worked extensively with regular teachers in 
demonstrating assessment tools and techniques so that these teachers 
could discover individual needs of EH pupils, provide a remediation 
-program- and evaluate the results of instructional activities* 

Under Objective 1*3 will be found some of the evaluation team 1 a 
results which indicate the success of Title VT«G f s intervention program 
in the regular classroom as well as in an EH room since many of the 
target pupils for the project were not in self*contained units* 
Project Objective No* 4 s 

Implementation of alternative patterns of service by support personnel 
(principals, social workers * school psychologists, etc*) to pupils and 
teachers * ? 

Objective 4,1$ Providing general and specific staff develojraent 
in relation to learning disabilities and their 
remediation* 
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..u Assessment- Toole , 

i WRAT ' 

•K-jS^^v>7:::v f r: : -. •.••:■-/.:•/: wSv^'Fv . • . . ••v-- ;: 
. ■ Rated Assessment ( Math -Reading ) 

;/ 7 Self-c one ept Inventory 

• Markof f Informal Inventory 

Slingerland • 



Interventione 

Task analysis 

Behavior analysis ? 

Academic objectiyea ■ L : ■•■ •" "/'• •'• • 

Prof esaibnai su^ 

Individualized instructional 
techniques : r r y>]^V;'j':' : . 



Project staff development 
Staff contacts specific to this objective 184 : v : .:-- v: \;/.^-' . r 



Workshop contacts specific to this objective 
Outcomes : •' • ' : .' • 

\.y-TheTitle\VlTQ; staff involved support personnel in workshops and 
on-site consultation in planiiing and implementing programs for the 
children with learning disabilities and their remediation. 

Objective 4»2; Allocating space, funds t materials and personnel 
support for the daily operation of an EH program 
within a building. * J 

Interventions 
Task analysis 
Behavior analysis 
Professional support personnel 
Management of the environment 
Project staff development 
Workshops 

Staff contacts specific to this objective IS8 
Workshop contacts specific to this objective ll 
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i-t^gst sites^ 

? for materials needed in order to individualize programs » Personnel support 
was obtained from support personnel 4 on-site and regular staff on* site. 



bbjeotive 4 . 3 s ltotaM,ng tHe severity of student needs to the 
amount, frequency! duration and number of 
• ^ services of different people required, 

jfe^^ ..--^ 
WHAT Task analysis 

/Rated Assessment (Math*Readittg} Behavior analysis 

MarKoff Informal Inventory Academic objectives 

Siingerland , Professional support personnel 

v : ■ Management of environment 

Individualizing materials 
Project staff development 
Workshops 

Staff contacts specific to this objective 162 
Workshop contacts specific to this objective 47 
Outcomes ; 

Title VI-G staff was instrumental in emphasizing to support per* 
sonnel staffs the necessity of evaluating the services required by a 
pupil according to the severity of the pupil 1 a needs* Support personnel 
were encouraged to enter the classroom and use their skills within a 
regular classroom setting. 

Objective 4,5 s Obtaining educational assessment data which will 
result in changes in the instructional program* 
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Assessment Toola ; . interventions 



V; ' WRAT. 

i/; ; uilinore Professional support personnel 



Task analysis > 



Irrilyiduaiiz ing • ii^tructional 



. Rated Assasment (Math-R©adiM) _ 

. . techniques 
. - . Markoff Irtformal Inventory ' , 

Slingerland Individualizing materials 

Project staff development 

, v : /'- " : --jr Workshops 

— Staff contacts l^^TfrQ~tb''^s"obleo"^v< r ' *185 " "Tr*" T! '"T^" " 

Workshop i contacts specific to this objective 33 

Outcomes > " '• 

Support personn^ 
/tools, through wrkshopsra^^^ 

They were also trained ih^the t^ results of these ^ assess- 

mants into individualized, iristruetiphal programs and instruetional pro- 
grama to fit the needs of groups or classrooms of pupils, 

Pro.lect Objective No. 

Working with teacher ^ toaining institutions to provide opportunities for 
teachers ^ 

e^erienees with; students ; parents , B *ad s^ 
instruction and consultation. 

Objective j.lt To what ertent (frequency, '; duration and quality) 
WM PW>joot able to provide practicum experiences 
' with pupils, parents, school staffs in pupil 
assessfflent, instruction, and consultation? 
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Objective 5*2 g What methodologies (types and effectiveness) 

were used to establish linkages between project 
and teacher training institutions? 
1 # Contacting teacher trainers 

a* personally (in conference setting) 

b. by telephone 

c. by letter 
2. Project 

a* dissemination of information about 
Title VT»£r to teacher trainers and 
district personnel though workshops. 



- meetings and personal contact* 
Refer to Target School Appendix. 
3» Plssewihat^ 

university ; student s through student visits 
to Title VI-0 and presentations in class- 
room setting at teacher training institutions , 
Objective 5.^s What experiences are required to assist in bridge 
. . 1 ....... . .. tbe gap between. theory and. practical a 

• • v } /-. tion? ; '^i^ i--.^'^ 

1 * Provide interns with an opportunity to observe 
a variety oif educational settings and tech- 
niques prior . to field placement; , 
1 " a* to help interns identify areals of interest 

: ' b, to help interns plan course of work arid 

;;v,^.',. : , •, • .. .; .. ..... .. coordinate it-i^h praetici^ experience 

2, On-site work early in intern 1 s training program* 

a . base this experience on problem solving 
in real situations 

b. coordinate theory with practical situation* 
Theory is most effectively learned and 
utilized when there is a need for it* 

3* Increased emphasis on interns recording of 

their activities and relating their activities 
to theory through conferences with supervisors* 
instructors, project staff and field site 
personnel* 
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4.'' Increased and mora frequent feedback for 
interns by supervisory personnel on t 
a. interns competency in analyzing situations 
and defining problems v 4 ; 
a b • proficiency in applying teaching techniques 
and sld.lls 
c ♦ appropriateness of materials ; 
:vd*;; appropriateness of diagnostic tools— - — - 
©•use 6f diagnostic information 
f. program planning for pupils 
Model for continiaation of intern experience- What 
do teacher trainers, university students and school 
district personnel in the project perceive as 
necessary and relevant eseperiences in preparing 
them to assist- students, parents and school staff s? 
1* increased backgrotand in instructional techniques- 
wider repertoire to offer inte 
2. awareness of interns expectations and goals 
3# closer work with interns regarding their 
individual needs I 

a. schedules - commuting time, etc* 

b, amount and type of direction and support 
* o • clear view of role in field placement situation 

j d* clear definition of who they are accountable 
to and what expectations are to be met 



P^IJCATIQNS 

The following are implications based upon completion of the objee- 
of the Title VX-G Project* 

X , The effectiveness of project staff members to assist regular 
elassrp^ teachers to meet the needs of learning disabled 
pupils" teachers 
to accept the move toward mainstreaming in California* 

2* The leading team concept of shared responsibility between 

teaching and support staff will provide increased opportunities 
to better meet individual needs. 

5, Release time as provided by trained substitutes, proved to be 
an essential element in the projects operation. For My 
project to provide service, a release time component must be 
considered* 

4. A defined pupil assessment package provided the project staff 
with a means of ' determining appropriate interventions and 
also provided participating teachers with an approach for 
measuring self-concept, behavior, and academic progress* 

5 # The development of Educationally Handicapped (EH) t teachers 1 
skills in planning and implementing interventions for EH 
pupils provided the local school with Special Education teachers 
as reeognized resource persons to the regular teaching staff. 
This will be especially valuable in light of the mainstream- 
ing concept* ^ = ^ 

6* Title VI-G work with support personnel (principals, social 

workers, psychologists, etc*) provided schools with additional 
skills service by personnel who are regularly in the schools. 

7. Relocation of Title VI-G staff and Resource Center to a per- 
manent existing centralized location provided the opportunity 
to combine the resources of Regular Education, Special Educa- 
tion, and IB in one building. 

8. General Education increasingly accepted the Title VI-G 
Project as a resource for the General. and Special Education* 
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QtTOEX^iES TO feftOJiCT OPERATORS 



The following reoc^iaenidationfl are made by, the Title VI«6 sta^ 

to guide other project operators t ? = 

* ; l.v Initiate staff activities for planning arid orgaMiatiori 
of project activities prior to the actual regular school 
year, y;'/ .y ■ . ^ ',, 

2* Staff characteristics should be consistent with objectives 
and needs of project activities f 

a, familiarity with the district as well 
personnel with outside experience, 

b, the educational background should be 
in regular and special education 

c# staff members should be experienced 
teachers. • 

3* Refinement of project forms and instruments should be 
established prior to the advent of project activities* 

4 # On-site coordination with teaoher- training institutions 

should be initiated prior to the school year and continued 
throughout the school year if student-interns are a part 
of the project, 

5* Personal contact with school staff should be made rather 
than depending on indirect means - telephone f notes, etc, 

6* An on-going feedback and exchange system should be developed 
between the project and any replication districts* 

7* The evaluation system should provide for on-going site staff 
to assist in interpretation of data, 

8, State Department consultation should be continued at the 
site-level 

9* Substitutes for teachers should be provided to enable 

teachers to attend workshops and classroom observations. 
Substitutes should be trained in Title VX-0 model pro- 
cesses and should be maintained as a unit, 

10, Workshop activities designed specifically to include the 
ancillary staff should bo initiated early in the year to 
better facilitate the monitoring of effectiveness in imple- 
mentation of the workshop ideas in the on- going program. 
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V 11. A team approish shbuld 

, action and continuity within the team. Teems should be 
designa te n^t^ of the team staff to that of 

the school site staff to provide the school oorrtinuity 
after the project staff withdraws. Regular bi-mtnthly 
- staff meetings should be required, T 

12 • ; Team^work^ b^ staff members at a single site was 

| :' often more produo tive in light of support and varied skill s 

provided • A team approach should be utilized as much as 
possible. To facilitate interaction and continuity 
within the team f regular bi-monthly staff meetings should 
be required, 

13* Workshops at the end of the year should be continued as 
they help teachers and pupils to realize a M turned on" 
attitude toward learning even as the year ends. Those 
conducted during the year were natural motivators and 
should also be continued. 
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services to chud rbj 



The proposal for the third year continuation of Jbhe; project 
specified that direct service to Educationally Handicapped pupils 
should be limited to 153 pupils • - : i 

, The proposal was modified to exclude the 24 non-public schooT 
pupils so the: target population of direct service pupils was ad- : 
justed to 129 pupils. .... _ = ' 
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DIRECT SERVICE. TO CHILDREN - 1973-1974 

: ( Hot "Through Workshops 1 ; ; 
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15 . 


0 


10 


0 


2 


Portal a 
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Replication Schools . 
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Clairemont 


170 


95 


' 16 


23 


3 


Nicosio 1, „ 


45 . 


1 




1 


2 


1 


Lincoln 


15 


i ; 




1 




1 ' 


Laguna 


15 


i 




1 
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Argonne 


25 


0 
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2 


18 


• 0 


University Mound 


20 


20 


20 
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0 
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Andrew Jackson 


10 


10 . 


10 


0 


0 " 
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Everett 


100 


60 
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• 0 


0 


0 


Lafayette 


' 18 


18 


• 6 


0 


0 


0 


Langley porter 


12 


12 


2 
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TOTALS 


1.842 


523 


161 


113 


875 
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... Workshops direct service to pupils; 611 



STAFF Dl^LOIt^n? 



1 , Nviaber of staff pereormel receiving contact through in-servioir 
training this year via workshops • 

Totals • 

Av Regular Classroom Teachers 

B. Central Office - Administrators 

C. HI Teachers 
D* Others: 

Iffl Teachers 
State Staff 
Compensatory Ed Staff 
Ancillary 
Para Prof essionals 
Interns 
Parents 

Bilingual Teachers 
Title VI - Staff 

2. How? 

Workshops via modes of demonstration f observatieni lecture, discussion, 
participation by ej^erimentation, audio-visual and multi^media, 

3» With what frequency? 

84' workshops/average of nine each month* 



4, Number of para professional traineds 

48 contacts 
5* How? 

Workshops via modes of demonstration » lectures and audi-visual* 
6, Frequency* 
*. Bi-monthly 

* Persons may have attended more than one workshop. 



*2*l8 



32 
198 



2 
3 

263 
48 
16 

252 
25 

229 



Included also 
on chart 
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REPLICATION ACTIVITIES 



During the 197>7^ school year the Title VI-G Project proposed to re- 
plicate and evaluate all or portions of the concepts and materials in 
inner-city schools ( Oakland ) and - .urban and rural schools (Marin County ) , 

Oakland ^blio Schools ; 
Special Education Department 
1025 Second Avenue v ^ 
Oakland » California 

a* Components to be used: 

1 . On-site aid from resource or reseach teachers 

2. Vsi of outside and district consultants in reference to eb*- 
taining expertise in various areas relating to the learning 
disabled student* 

3* Provision and interpretation to regular classroom teachers 
of di&ipiostio and prescriptive work-ups with readily usable 
lesson plans (Pacific Medical School interns)* , 

4* Adaptation of resource and material making center with 
emphasis on teacher made materials* 

b • Total number of pupils served; 64 white and 79 blacks. 

Marin County Schools 
201 Tamal la ta Blvd * 
Corte Madera, California 

a* Components to be used: 

1, Development of Learning Centers * ma th t reading* 

2, Use of formal and informal assessments to be used in pro- 
gramming for individual students* 

3* Use of resource teacher for demonstration teaching* 

4. Workshops with interchange between replication district 
and San Francisco Unified Title VI Project* 

b. Total number of pupils served 1 75 white* 



HACI®fDA-LA PUimE UNIFIED SCHOOL DISTRICT 
15959 East Sale Avenue 
La Puente, OA 91744 

This district, replicating the Title vi-G project in San Francisco, was 
funded under Title VM funds from the State Department of Education* 
The objectives for 197>74 f together with the activities werei 

OBJECTIVES 

1* Accelerate academic achievement and/or level of adaptive be- 
havior qf educationally handicapped* 

2, Increase skills of EH teachers in assessment, designing eduoa-* 
tional interventions and evaluation, 

3. Increase assessment skills and instructional strategies of 
teachers receiving students. 



4, 



Increase substitutes and trainee's skills in environmental 
management techniques. 



5. Increase level of parent skills in using behavioral management 
techniques with their children* 

ACTIVITIES 

1. Student assessment workup; selection of interventions and 
writing of individual program, 

2, Students placed in intensive service class to facilitate academic 
and adaptive changes, 

3* Staff development activities in observation and recording, assess* 
ment, instructional strategies, 

4, Field follow-up of students and teachers to assist applying 
observation and assessment skills, 

5, Field consultation to teachers to improve instructional programs 
and management techniques, 

6, Parent involvement in individual and group instruction to 
develop behavioral management skills, 

7* Dissemination of procedures and outcomes both. 

Total Pupils Served; 204 (57 Spanish Surname) 
Personnel Trained! IJG Teachers 

3 Teacher Aides 

3 Specialists 

Total Title VI»B Funds t $ 92,9 kg 

Total District Pund^ 
State - Special Ed 
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REDLANDS UJOTIED SCHOOL DI8TOIGT 
P, 0, Box 1008 
Badlands, CA 98373 



This district, replicating the Title VI-0 project in San Francisco, re- 
ceived funding far their project from the State Department of Education 
under Title VI-B funds. The objectives for 1973-74, together with the 
activities, wares 

OBJECTIVES 

1, For each student processed with the Diagnostic Service Center 
(DSC), a detailed prescription for amelioration of identified 
learning disabilities will be developed, 

2. By the end of the 197>«74 school year, all DSC students will 
demonstrate (a) sipiifioant academic progress and/or (b) more 
appropriate adaptive behavior, 

3* Training program for at least two teachers will be developed. 



ACTIVITIES 

1, Each student processed will spend an average of 5-8 weeks in 
the Center, 

2, Each receiving teacher will modify the plan when necessary. 

3- Staff development sessions to develop and assist in modifica- 
tion of plan, 

4 S Teacher will identify specific behaviors that need to be 
changed in keeping with prescription and will carry out 
specific instruction.. 

5. Teachers will establish performance criteria for determining 
progress toward terminal objective and use appropriate tests 
to assess progress, 

6, Receiving teachers will record success of students in areas 
described as learning disabilities or maladaptive behavior 
in original prescription. 

Total Pupils Served i 75* (15 Spanish Surname) 

(1 mack) - " 

Total Personnel Trained! 49 Teachers 

19 Aides 

Total Title VI-B Funds! $40,028 
Total District Funds 1 6,039 
State (Special Education)! 20,890 

$66,957 
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STAFF UTILIZATION CHART 





5(5 




Marguerite Dugger 



Elaine Fisoha 9/fl-2/?2 
Milton Bonsill 
Charles 



Stevenson - Tennessee Kent 
Jose Ortega - Walter Morris 
Potrero Hill - Tom Sauion 



Carmeila Cottonare 9/fI-2/f2 
Aveline Coale 2/72-6/72 " 



Douglas Reed 9/7UG/71 
Sally Jorgenaen 10/71-6/72 



Potrero Hill - Tom Samson 



Lai 



Larry Brikka 



Marguerite Dugger 



Joyce Kohfeldt 



Laboratory discontinued 
Laboratory discontinued 
Laboratory discontinued 



All Labs Discontinued 



Beverly Conen 
Carol Lie S/lUfl) 
m Eggera )t\>% 



Bitty Thomas 
Johanna Mmon 
Diane Onorato 



Potrero Hill * Tom Sara 



Edna ten 



TadAlpar 
Tom Whalan 



David Man 



Mirpirite Bugger 
Audrey Rodman kftUftk 



Jane Anderson 



Marion Killer 
Kathleen Shindsu 
Jtoy Eggers 



Betty Thoniap 
Victor Milhoin 



Lirton * Karion Heimsoth 

Bitty Motaara, Director 
Teacher Learning Center 
2/?4 - 6/^ 



Edna Bewail 



Ted Alper 
Tom Whilin 
Support atafft Susan Ewy 
Paul Gariii 



Alex to 

Margaret Scheffelin 



JUJMDgSTRATIVE STAFF 



Stats level 

Charles W. Keaster, Ed.D. f Consultant 
Bureau for Mentally Exceptional Children 
Division of Special Education, California 

Margaret Seheffelin f Ph.D. ^Consultant in Testing and 

Evaluation Unit, Division of Special Education 
State Department of Education, California 

Local level 

Jane Anderson, Project Head 

VI-G Model Delivery System 

San Francisco Unified School District 

Septeaber 1973 * June 197% 

Marguerite Dugger, ED.D. , IB Supervisor 
San Francisco Unified School District 
September 1971 - January 197^ 

Audrey Rodman, EH Supervisor 

San Francisco Unified School District 

April 197^ - June 197^ 

Joyce Kohfeldt, Project 4 Head 

Model Delivery System 
San Francisco Unified School District 
1971 - 1972 

laboratory Teachers 1971 - 1972 

Milton Bonsai - Intermediate 
Charles Eklof - Junior High 
Elaine Fische - Primary 

Laboratory Principals 

Tennessee Kent - Robert Louis Stevenson (Primary) 
Walter Morris - Jose Ortega (Intermediate) 
Tom Sammon - Potrero Hill (Junior High) 

Resource Ttaohers - Elementary 



Aveline Coale 
Beverly Cohen 
Carmella Cottonare 
Mary Crosby 
Arry Eggers 
Carol Lee 
Marion Miller 
Kathleen Shimizu 
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2/72 
9/72 
9/71 
9/72 
3/73 
9/72 
9/73 
9/73 



6/72 

6/73 
2/72 
6/73 
6/7^ 
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Resource Teacher - Secondary 



Sally Jorgensen - Junior High 10/71 - 6/72 

Victor Milhoan - Junior and Senior High 9/73 - 6/74 

Diane Onorato - Junior High 9/72 - 6/73 

Johanna Peterson - Junior and Senior High 9/72 * 6/73 

Betty Thomas - Junior and Senior High 9/^2 - 6/74 

Administrators Title VI Office Sites 

Marion Heimsoth, Principal, Lawton Elementary School 

Tom Sammon, Principal, Potrero Hill Junior High School 

1971-1973 

Betty MeNamara t Director , Teacher Learning Center 

2/74 * 6/7k 



Secretaries 

Janis Lee 1971 - 1972 

Edna Bowen 1972 - 197^ 

Evaluation Consultants 

Ted Alper, Ph.D. 1972 - 1974 

Larry Brekka 1971 - 1972 

Tom Whalen, Ph.D. 1972 - 197^ 

Evaluation Support Staff 

Susan Ewy 1973 - 1974 

Paul Gareis 1973 - 1974 



State Department Consultants for Evaluation 

Alex Law, Ph.D., Chief Office of Program Evaluation 

and Research 
State Department of Education 

Margaret Scheffelin, Ph.D. , Consultant in Office of 

Testing and Evaluation, Division of Special Education 
State Department of Education 

David Uslan, Ph.D., Project Director, 
Systematic Program Development for Educationally 

Handicapped Pupils 
State Department of Education 
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APPENDIX A 



) 



61 



ERLC 



APPENDIX A 



SUMMARY OF DISSEMINATION ACTIVITIES 

The following charts indicate in summary form the overall dissemination 
activities through the three year project term* 

Included are the types of activities Incurred under the broad category of 
dissemination (materials 9 intervention techniques t workshops 9 and pupil 
assessment packages)* These charts are arranged under the headings oft 

• Other Districts 

• Community Agencies 

• Government Agencies 

• San Francisco Unified School District 

By Schools 

Special Ed* Services Division 
Superintendent and staff 
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OTHTO BI3MCTS 



Individual 

Mervintion Techniquea Pupil Asaeasraent 



Instructional Materials 


liseurci Room On=Site 


Workshops 


Packa 


Folk County, Florida 


I 


X 




X 


Highlands County, Florida 


I 


I 




X 


Houston, Teal 


X 




X 


X 


Foster City 


X 


■rr 

1 


X 


I 


Berkeley Schools 


X 




X 


X 




T 

A 




X 


X 


Rant? ClkTk Cfiiintv 

EH Department 


X 


I 


X 


X 


San Meo City & County Schools 


X 


A 


Y 
A 


Y 

A 


South San taeiseo Schools 


X 


A 


Y 


¥ 
A 


Sunnyvale School District 
EH Department 


x 


X 


I 


X 


La Puentij California 


I 


I 


X 


X 


Redlsnds, Californii 


1 


I 


X 


X 


Hacienda, California 


I 


X 


I 


X 


Rowlands, California 


X 


X 


X 


X 


Santa Barbara County 


X 


I 


X 


X 


toard Schools 


I 


X 


I ■ 


X 


Castro Valley 


X 


X 


X 


X 


Illinois Schools 


X 


1 


X 


X 


Boston, Massachusetts 


X 


X 


X 


X 


Mare County 


X 


X 


X 


■X 


Torrance, California 


X 


X 


X 


X 



OTER DISMCTS 
(Coatisuid) 

Inatrue 


itlonal Materials 


Intervention 

KgSQUTOS MODE 


Teohniquil 

1 Un^ylWi 




Mvidual 
Pupil Assessmani 


Bay km yarning Center 


X 


X 


I 


I 


X 


Union School District, Karin 


I 


X 


X 


I 


X 


Denver, Colorado Schools 


I 


X 




X: 


X 


Austin, Tibs 


I 


X 




X 


X 


Los Angeles County 


I 


X 


I 


x 


A 


SacMaentOj . Calif ornia 


I 


X 




X 


1 


Cupertino, California 


X 


' x. 




X 


I 


Duvall Home for- Mentally Retarded, 


X 


X 






x 


Deland, Florida 












Cosmity total Health Center 
Education Department 


V 

I 


x 






X 


SpIitHm Florida 












..^Ji.. UFhw4-a1 TJasl^Vi ^sw^fil* 

GOMjnity Mental iieaiin uenwir 


I 


X 






X 


Vintiravin, Florida 












Depariment of Special Education 


X 


X 






X 


Phoenix, 'Arizona 












Santa Barbara 


1 


WW 

I 






A 


Fountain Valley Schools 


I 


X 






X 


Fountain Valley, California 












Lancaster School District 
Lancaster, California 


X 


X 






I 


Kern County Schools 


1 


X 






X 



ferial County Schools X 
: J« Ms Obiapo County X 
T £JM£ura Unified School District X 



f OTEH DISTRICTS 
(Continued) 



Instructional Materials 



Intervention Techniques 
Hisourcs Room On-Site 



Individual 
Pupil Assessment 
Workshop! Package 



Contra Costa County 
Depirtosnt of Education 

Soncca County Office of Education 

Shasta County Schools 

Grasp Unified Schools 

Stanislaus County Schools 

Oniversity of New Mexi co 
- Bepirtaent of Special Education 

y, -University of North Carolina 
OS 

School for Contemporary Education 
McLean, Virginia 

State School for Boys 
Toronto, Canada 

Newton School District 
Newton, Massachusetts 



I I I 

XX x 

X X x 

XX x 

XX x 

X X I 

X X t 

X x x 

X X x 

X X I 
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mwm AGENCIES 



hit-'-' 



Instructional Materials 



}. toiFhrieiieo ?ftdieal : Society 
P.T.A. San Saneiaco- M Wstrtet, 
California Congress of Parents and 

. Ctdars Dsvflopcent - Center, Marin 
San Francisco Educational Ausliary 
President, Parents F.A.C.L.D. 

;Mssion Cemunity Mental Health 

Colleges and Universities 
, MYersity of California at 
San Francisco 

Appalachian State 'College, 
Itorth'Carolina 

Hayward Stats 



Leadership gaining Institute, 
Tuscorii Arizona 

University of Oklahoma 

Dominican College, 
San Rafael, California 

University of California, . 



I 
I 

I 

X 
I 
X 
X 



1 
I 



^"niveriity of South Florida 



X 
X 



■Intervention feohniquei 
Eesouree Room Dn-Site 



I 

I 

I 
1 
I 



I 

X 

1 

1 



X 

I 



Pupil Assiisient 
Msliops Package 



I 
X 



X 

X 



X 
X 



X 



X 

X 
X 
X 

X 



X 
X 
X 

X 

I 



pi.. 

ill 




Iff 



Instruotional MerialE 

V.-X;; :',7 .. 

^:; : "::--x : ;/f. ; - ; . 



i 

2 
X 

X 
I 



Rtsoufee Room QfcSite Jbrkshocs Package 



X 
X 
X 

X 
X 

X 
X 
X 



X 
X 
X 

X 
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|§g§,: V ■ . GOVlM'fflr AGENCIES v ; ,7 

! - : : ; : • .; . Pi^dl Assissment 

fk" batructlonal Materials Resource Room; : " Qo-Slte Workshops Package 

fc : -IPorSTtHs Goi^i No. Carolinav I X 

II- .- Reading Consultant, ' . •• " V • 

W< Ifeartent of Defense 

| European .©epentot - School System I 2 

Florida' State Deparfaintj _ 1 ^ ^ 

| f ■ ; Special Education Wviiion . 

The institute. N.I.K.H; Tampa X. , X X 

California State Departaent 
Ifc Consultanta 



Director, Health Education X X 

Stiti Depirtoent Special ^ j 

Edueatiori Consultants " • - 




X. ■ X 



lavren Prochictions X X 

Control Data Institute X I X 
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Intervention Techniques ■ lupil Assessment' 



Qs 
ft 



Schools 
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Appendix B 

OVERVIEW OP TITLE VI WORKSHOP raVQLVBMIT 

listed are the three categories of workshops involving Title VI staff* 

A I * DISSEMINATION WORKSHOPS Pa 9 e 68 

Title VI staff disseminated materials and project goals to regular class- 
room teachers , m teachers and administrative staff outside of target 
schools* The above personnel frequently attended workshops which were 
given at target schools and other sites. 

Paqe 80 

A II. TARGET SCHOOL WORKSHOPS 

Regular classroom teachers , EH teachers, principals, counselors, social 
workers, interns and para-professionals from target schools received 
in-service workshops through the Title VI-G staff* This involved 12 
target schools in San Francisco (K-12), and 4 schools from the replication 
districts (K-12). 

A III. STAFF DEVELOPMENT WORKSHOPS Page 92 

Title VI-G staff participated in workshops to enhance their own pro- 
fessional growth and to act as a dissemination service for this inforaiation. 

The following appendix includes non-commercial materials, used in A I* 
Mssemination Workshops A II, Target School Workshops A III, Staff Deve- 
lopment Workshops, 

On the right hand comer of each item are numbers indicating the specific 
workshop(s) in which these materials were used. This number corresponds 
to the workshop number on the charts. 

Published materials demonstrated in workshops are listed chronologically 
in the bibliography. . The numbers following each item correspond to 
workshop immbers as found in the left hand margin of each workshop chart. 
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A I. DISSEMINATION WORKSHOPS 



The following charts indicate the number of dissemination 
workshops involving the Title VI-0 staff* The charts 
include the workshop number, the site, the presenter, 
the mode in which the workshop was presented, the date 
and time, the number of participants arid the subject areas 
covered. 
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A II. TABOET SCHOOL WORKSHOPS 



The following charts indicate the number of Target 
School Workshops involving the Title VT-G staff. The 
charts include the workshop number , the site, the 
presenter, the mode in which the workshop was presented 
the date and time, the number of participants and the 
subject areas covered. 
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A III, STAFF DEVffiiOPmra WORKSHOP 



The following charts indicate the number of Staff Development 
workshops involving the Title VT-G staff. The charts include 
the workshop number, the site, the presenter f the mode in which 
the workshop was presented, the date and time, the number of 
participants and the subject areas covered, 
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Appendix C , : / 

TITLE VI-»G WORKSHOPS IN TARSIT AREAS 

The chart of total workshops shows the total number of staff 
contacts through workshops to fulfill the broad objectives of the ^ 
projects in areas 1,0} 2*0; 3*0? 4,0; 5.0. These workshops were pre- 
sented during the school year September 1973 through June 197^ and 
were directed toward staff improvement in Title VX-G target schools 
in San Francisco and the two replication districts, Oakland and Marin 
County. 

Each unit represents a Title VI staff member, or additional re- 
source person hired for workshops in their specific area of expertise 
The charts following the master chart represent the number of work- 
shops meeting specific objectives 1.1* 2, if 3.3 etc., held in grade 
levels K through 12 and the replication districts from September 1973 

through June 197^* 

The .large number of workshops are shown because many of the 
workshops met more than one objective, therefore the workshop was 
listed whenever appropriate* 

In meeting objectives 2*0 and 3.0 there was a high ratio of 
workshops held for E.H.. L.D.G, personnel. There are 123 E.H f L.D.G. 
teachers within the 3,000 certificated positions in the San Francisco 
Unified School District and there was also a high ratio of regular 
teachers receiving in-service training ~ilirough Title VI-G workshops . 
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WORKSHOPS IN TARGET AREAS 

1,0 Mianeement of behavior f self-concept and agidtniis areas for pupils with learning and/or 
behavior disabilities, 
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U Diveloptnt of EH teachers' skills in planning md implementing intervintioni for 1 pupils 
and in assisting other on-site staff in sharing thi instructional ac 
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WORKSHOPS IN TARQST AREAS 

2,0 Development of EH teachers' skills in planning and implementing interventions for 1 pupils and 
in assisting other on-site staff in sharing the instructional activities, 
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3*0 Development Qf regular liieheri 1 skills in the ideatifie&tignj asecrainfc and iflatfaetion ef pupils 
with leitrnina 4iffieulties, 
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WORKSHOPS E MM! AREAS 
4,0 Implementing alternative patterns of service by support pirsormel (principals, social worksrs 
school psychologists, ate,) to pupils and teachers, 



>/2- 



o 

00 



59 





^ 1 




X., 






..£.. 




J. 


M 


I. 


r — 

„tf.j 


o 


0 


0 


0 


0 




6 


0 


} 


0 


i 




0 


0 


0 


0 


0 


0 


V 


A 

0 




0 


V 


.31- 


0 


3 


0 


0 


(5 




0 


0 


1 








0 


2" 




1 

! 


0 


0 


f) 


6 


I 


0 


j 




0 




c 


0 




c 


0 




i 




J 


i 


0 


? 


0 


0 


0 


0 


IC 


it 


6 


b 





I — . 



9 

ERIC 



33L 



0 



0 



6 



U 



D 



o 



0 



0- 



0 



0 



6 C 



b 



(3 



0 



0 


1 

0 


c 


3 


2. 


t, : 


c 


0 


, c 


0 






0 


0 


0 


1 


1 


3 , 

— . 




0 

j 




1 X 


I 


1 


b 


1 

lb 


0 


1 


i 

c 


EE/£ 



in-service) to tee stored PMU C *«t« 
S asient, totruction and .option. 



ill 



0 
<0 



II- 1 



161 

ERIC 



. . . ; . - -; • 



i 


0= 


] 

I 

.C 


0 


1 i 


0_ 


sx 


0 


c 


0 


0 


0 




e 


0 




. (j 


Sl 




D. 


0 


0 


0 


0 






1 









0 



0 



0 



0 



0 
0 



£i i C 1 


* _ .. _ _ 


1 


0 




c 


D' 

i 

I 


0 


0 




c 




0 

H 'l " (* 




;t. 

, TX~ ™ e - 


.0' 

■ i-m-f 


0 

T 


0 



0_ 

0 
0 

0 

c 



D 

0 

0 

D 



0 



0 



0 

c 







i 

1 


i 




0| 


rs ! 
U [ 


6 


I 
f 






0_ 


i 
i 

t)l 


0 


0 


I 

t 
I 

0 


i 








n 


0 


0 


T 






D 


Ic 


jo 




r~ 


1 


0 


j.0. 


|o 

1 II H 


0 


c 


0 


c 


C 


0 


! 5 


0 


"p 1 



H IB 

.0 



s 



6 



D 

lb 



WORKSHOPS HTARQ1 AREAS ; ;.,.l\.' 
5,0 Working vdth teacher, training institutions to provide opportunities for tiicner (pre-sirvice and 
in-service) to have lonitorid practicum experiences with students, parents and school staff s in 
pupil assessment, instruction and consultation, 
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Appendix D 
TITLE VI-G STAFF CONTACTS - 



OTHER THAN WORKSHOPS 



The master chart India ate a the total number of staff contacts made 
in the target schools other than workshops* It indicates how many staff 
contacts were made in servicing students , classroom teachers and ancillary 
and administrative staff. Each unit of one represents a Title VT~G staff 
member involved in on-site intervention, planning, and implementation 
within the general objectives 1.0; 2,0; 5*0? 4.0; and 5.0. 

The charts following the master chart indicate the units of 
Title VI-G staff time spent in on-site service within the specific objec- 
tives 1,1; 1.2; 2.1 etc., in grades K through 12 and the replication 
districts from September 1973 through June 197^* 

Here again in reference to the number of IB, LDG staff numbering 
125 out of 3,000 certificated personnel in the San Francisco Unified 
School' District, it is evident that objectives 2.0 and 3.0 received a 
proportionately high ratio of contacts from a basic staff of six 
resource teachers. 
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Appendix E 
WORKSHOP EVALUATION PORH5 



These evaluation forma were used to collect feedback informa- 
tion from workshop participants. Several included pre and post 
questions and others were only post questions, 

The numbers in the right hand earner identify the workshop 
for which the form was used (refer to the workshop Appendix B s Pg t 67 
decode these numbers.) 
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x-i . •; : a-1 #6 

#27 

Name Title of Workshop 



School , Data 
Assignment ; r ' . 



Please use the l f 2 f 5, 4 scale in responding to the following questions, 
Number is "low" \ number k is "high" * 

PRE 

l s How would you rate your willingness to participate in demonstrations 
presented during a workshop? 

1 2,3 4 

2, How frequently do you make your own instructional materials? 

12J4 

* 3, Please indicate the level of individualized instruction presently 
implemented in your class. 



4* Which of these items are appropriate to your needs? (Please indicate 
the degree of appropriateness - l f 2 f J p 4) 

Teacher made material s Equipment ^ 

Gonmercial nuiterials Staff Resources 



5* Which of the following are major problem areas for you? (Please 
indicate by using 1* 2, 3, 4) 

Behavior ^^^^^^^^ Parent/school relations 



Academic ; Communication other 

Professionals 



Gosraents % 



EH Model Project, Title -VX-0 

10/ " 192 




1, What was your level of participation in activities during this worksho 

12 3^ 

2* How would you rate your reoeptlveness to increasing your frequency of 
material development? 

1 2-3 4 

3* How effective was the plamiing and organisation of the workshop? 

1 2 3 k 

4* Show which of the following activities were a part of the workshop and 
indicate the effectiveness of each by adding the appropriate number 
(It 2, 3, 

Panel presentation Demonstration 



Small group discussion Multi-media techniques^ 
Lecture _________ Project assignment 



5# What is the likelihood of your implementing ideas gained from this 
workshop? 

1 2 3 4 
Comments i . . . _ . 



EH Model Project, Title VI-G 
10/73 
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■■■■■^■^■-/v : ::\.w 



x " 2 A-II #11, 14 

#21 5 

Nam ^ _ Title of Workshop 

School . Date ^ 

Assignment 



PRE 



Please use the l f 2 f 3 f 4 scale in responding to the following questions* 
Number !_ is "low," number k is "high,- " 

1. Please indicate the level of individualized instruction presently 
implemented in your classes* 

1 2 3 4 

2 t How would you rate your ability to diagnose learning problems in the 
classroom? 



3* Which of the following are major problem areas for you? (Please indicate 
the degree of appropriateness l f 2, 3, 4) 

Behavior Parent/school relations 



Academic mm ^ ma ^ mi ^_ mmmm _^^ Comunieation with other 

. r professionals 



4, How much resource help do you receive for children with learning problems 
in your classroom? 



5- Indicate your ability to provide effective intervention for behavior 
problems , 

12 3 4 

6, Please indicate your familiarity with the identification and use of 
learning modalities — (i ( e, visual f auditory, kinesthetic, etc*) 



Corments i 



er|c 
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P03T 

1, Please indicate the effectiveness of this workshop in increasing your 
knowledge or profioienoy Ini 

A* Diagnosing learning problems 

1234 
B# Providing effective intervention for behavior problems 

1 2.3 4 

C* Identification of learning modalities 



2, What is the likelihood of your implementing ideas gained from this 
workshop? 

1 2 J 4 

3* What is the probability of your seeking more resource help? 

I234 

Commantss 
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X-3 . A-11 #12 

WHAT 1 3 HAPPENPJQ IN I^RNDfS DISABILITIES 

A. Session A.M. or P .M. 
1, Please indicate the overall effectiveness of the first session 

(Low) 12 3 4 (High) 

2* What is the likelihood of your implementing ideas gained from this 
program? 

(Low) I234 (High) 

5. To what degree did the group meetings pertain to your interests? 
(low) 1 234 (High) 

To what extent were practical aspects of education dealt with? 
(Low) 1 2 3 4 (High) 

B, Session A ,M. or p ^ 

l s Please indicate the overall effectiveness of the second session you 
attended* 

(Low) 1 2 3 V (High) 

2 , What is the likelihood of your implementing ideas gained from this 
program? 

(Low), 1 2 3 4 (High) 

3* To what degree did the group meetings pertain to your interests? 

(Low) 1 2 3 4 (High) 

4. To what extent were practical aspects of education deal with? 

(Low) 1 2 3 4 (High) 
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i A-II #30, 33 

# J w>, *3 

VOLUNTEERS WORKSHOPS 

Please respond to the following questions, 

1. Do you prefer to .participate or observe demonstrations? 

1, Participate in m ^ tmm ^ m ^ mam _ m __ m _ 

2, Observe ^^^^.^^ 

5* Both . 

2, To what degree has information offered in the workshops been of use to you 

(Low) 12 3 4 (High) 

3* What gains do you feel you have made in regard to understanding 
.individual styles of students? 

(Low) 1 2 3 4 (High) 
4* Please rate your ability to deal with behavior problems* 

(Low) 12 3 4 (High) 
0* Have you made your own instructional materials? 

1* Regularl y 

2. Occasionally _ 

3* Very seldom 



6* How would you rate the effectiveness of games as learning tools? 

(Low) 12J4 (High) 
7. How would you rate your ability to tutor for specific learning problems? 

(Law) 1234 (High) 

_ 8. How much resource help have you received for students with learning 
problems? 

(Low) 1 2 3 4 (High) 

9 # What types of additional workshops would be of interest to you? 

1 

1, 

2, ' 

3, y " " ~ " 

10, Please rate the overall effectiveness of the workshops you attended. 

(Low) 1 2 3 4 (High) 
Thank you for your attendance and cooperation. 

o .197' 
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OTORICDLtJM fflSOIJSCl MY 



Do you think you will actually implement ideas gained from this 
workshop? 

1. Yes ,. 

2. Not sure _ 

3. No^ 

Did you take part in any activities during the workshop? 

1. Yes __ 

2. Sort of 

3. No ' 

Did this experience provide input which you find helpful? 

1, Yes 

2, Not sure 

3, No 

Did you lee any materials you would like to duplicate and use? 

1, Yes 

2, . Possibly ..... 

3, No - 

Comments ■ 



Name 1 item you would like to provide for you 
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A-II 



CURRICULUM RESOURCE DAY 

PRE 

1. What type of workshop or inserviees do you have an interest in or 
feel a need? 

1. " 

2, - 

; 3* , _______ 

2* Do you prefer to participate in or observe demonstrations ? 
1* Participate in H _ = _ BS _ — 

2, Observe m=mms=mmmmm ^ a ^ Bam ^^ mmmm ^^ 

3. Both - 

3* How frequently do you make your own instructional materials? 

1, Regularly mm ^^^ /mmatmamamm ^ =ma ^^ 

2. Occasionally 

J. Very seldom ^^^^ ^^^^^ fc » 1 ^ fii - B=- « -s — 

4, How would you rate your reeeptiveness to increasing your frequency 
of material development? 

1. High ; 

2, So-so ^ memmmmmmi _ ima ^ gma ^^ 

3* Low I 

Have you ever used learning centers in your classroom? : 
Yes - ; No 

Occasionally m ^ mmmm ^ m ^ smm _ mBa ^ mmmmmm 
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FEEDBACK 

Please respond to the following questions • 

1* Do you prefer to partiaipate or obsewe demonstrations? 



1. Partioipate in 
2 * Observe .. : ■ i ■■■■■ 
3. Both 



v.2i/ To what degree has information offered in this presentation been of ^ 

use to you?.' •■¥..>■ 

: (Low) 1 2 J 4 (High) 

5. ; What gains do you feel you have made in regard to understanding indivi- 
dual learning styles of students? 

' r; / ; v¥ (Low) 1 2 3 4 (High) 

4. Please rate your ability to deal with behavior problems . 

(Low) 1 2 3 4 (High) 

5* Have you made your own instructional materials? 

1> Regularly 

" " 2, Occasionally • 

3- Very seldom • 



6, How much resource help have you received for students with learning 

'-••problems? ■ ." - ; : ! ." '•''••';-' : " r '-. '/ . 

(Low) 1 2 3 4 (High) 
7» What types of additional presentations would be of interest to you? 

. i , _ ; '/ - ■ • - ■ 

' a, _ 

8 , Please rate the overall effectiveness of this presentation , 

(Low) 1 2 3 4 (High) 

9 • How wojild you rate your receptiveness to having a consultant work in 
your own classroom or school? 

(Low) 1 2 3 4 (High) 



E.H. HOMEBOUND TEACHERS 
Number responding to feedback 1? 



-I 



Objectives ! 

To identify problem areas of the homebound teacher and to 
find alternative solutions* 

To introduce multilevel materials to homebound teachers. 

To find ways for provision of better communication between 
classroom teachers and homebound teachers* 

Population Participants : 

Supervision of Homebound teachers and twenty- four Homebound 
teachers who have very little contact with regular class- 
room teachers and other ancillary staff. 

Participating teachers teach student in both elementary and 
secondary grades and are responsible for supplying instruction 
in all areas. 

Students receiving services of Homebound teachers vary 
greatly in academic abilities* 
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y- : . i Dissemination Workshops 
: .-'"-"V- " B«H> Homebound Teachers 

smmmY of pre"- post test 

PRE 

L * How would you rate your willingness to participate 
in demonstrations presented during- a workshop? 

I. How frequently do you make your own instructional 
materials? 

5." Please indicate the level of individualized 

- -instruction -presently implemented in your class 

I. Which of these items are appropriate to your needs? 
Please indicate the degree of appropr iatne s s 1,2,3,4, 
Teacher made materials 
Commercial materials 
Equipment 
Staff resources 

">. Which of the following are major problem areas for 
you? Please indicate by using 1,2,5,4, 
Behavior 
Academic ,, 

Parent/ school relations 
Communication other professionals 



>OST 



What was your level of participation in activities 
during this workshop? 

How would you rate your reoeptiveness to increasing 
your frequency of material development? 

How effective was the planning and organization of 
the workshop? 

Show which of the following activities were a part 

of the workshop and indicate the effectiveness of 

each by adding the appropriate « number - Panel presentation 

Small Group discussion 

Lecture 

Demonstration 

Multi-media techniques 

Project assignment 

What is the likelihood of your implementing ideas 
gained from this workshop? 
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A - II, #12 

' ,.. . - COUNCIL FOR EXCEPTIONAL CHILDREN WORKSHOP 

^Number of feedback sheets 29 



Ob,l8QtiV93l 



To disseminate information on California's Title VI Learn- 
ing Disabilities, 



ERIC, 
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£-*ir . Target School Workshops 

#12 Council for Exceptional Children Workshop 

Leadership Training Institute Component for Smorgasbord 

"What 1 s Happening in Learning Disabilities" 



IV Please indicate the overall effectiveness of the 
session 



Low High 
1 2 J 4 

7 6 21 23 



2. What is the likelihood of your implementing ideas 

gained from this program? 7 7 20 20 

j5- To what degree did the group meetings pertain to 

your interests? - > \ 2 5 20 28 

4* To what extent were praotioal aspects of education 

dealt with? , 5 10 18 21 
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A - II, #11 and #1 4 Test TEST AND LEARNING ASSISTANCE INVENTORY 

Annabeile Markoff Inventory 
Number of feedback sheets 24 
(Two Workshops) 

Objeetiveai 

1- To explore the use of test and learning assistance inventories 
that explore skills necessary for academic achievement* 

2. To train teachers and ancillary staff in the use of prescriptive 
intervention and evaluation techniques. 



Population 



Elementary and secondary regular education teachers, elementary and 
secondary ancillary staff, ESEA Resource Teachers, B.H., L.D.CK 
teachers elementary and secondary. 



; A - ; II Target Sahoor v Wdrkshops 

# 11 and 14 Tests and Learning Assistance Inventory 

SUffiiARY OF PRE - POST TEST 



j PRE Low High 



;<y : Directions: Please use, the 1 *2 r 3? scale in responding 
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Which of the following are major problem areas for you? 












(Please indicate the 4egree of appropriateness l f 2 f 3t^i) 
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Indicate your ability to provide effective intervention 
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for behavior problems 
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Please indicate your familiarity with the identification 












and use of learning modalities (i.e. visual, auditory. 
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Please indicate the effectiveness of this workshop 












in increasing your knowledge or proficiency ini 
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b. Providing effective intervention for behavior 
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c * Identification of learning modalities 
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What is the likelihood of your implementing ideas 












gained from this workshop? 
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What is the probability of your seeking more 
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MODALITY TRAINING - 
Number of feedback sheets 15 

Objective: 

To train classroom teachers in assessing strengths and weak- 
nesses in the learning modalities of their pupils using 
Slingerland Screening Test for identifying children with 
specific language disabilities. 

To train classroom teachers to use this information obtained 
in selecting teaching methods and materials. 



Population s 

The population participating in the workshop were regular 
education primary teachers, one E.H. teacher, Counselor and 
Principal, The population were staffed in a site school that 
received continuing services from Title VT staff* 



fc:>.: A - II, #21 



yy, * 
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ill... 

- A , - II j Target School Workshops 

- ■ - - - - - - - "f 

. #21 Modality Training " . 

^Directions: Please use the 1,2*5, 4> scale in responding to 
l^the following questions * Number I is "low 11 , number k is ^high 0 

PRE " ' ;../• - 

; 1 * Please indicate; the level : of individualized instruc- 
tion .pre sently implemented in your class 

2 ♦ How would you rate your ability to disgnose learning 
problems; in the classroom? Y 7 

|^^;.\^ioh of the fallowing are major problem; areas for 

you? (Please indicate the degree of appropriatness 1,2,3,4, 

; Behavior . . .. ■■ ■ 

1 Acadamio .:. 
W¥ L Parent/school relations - > ' 

Communications with other professionals 

. ■ • . . . • - . - • . . 

^How much resource help do you receive for children 
with learning problems in your classroom? 

15* Indicate your ability to provide effective interven- 
' " • tion for behavior problems - ... 

:;6. ..Please indicate your fajn^ with the identifica- 

tion and use of learning modalities (i.e* visual, 
v auditory, kinesthetic , etc » ) 

; POST V : ' ',-:.;.} .;. / ..• ■ *-;V • . 

•1 • Please indicate the effectiveness of this workshop 
in increasing your knowledge or proficiency ins 
a ..• Diagnosing learning problems 

; - ^b-*^^aviding- ef f ec tive intervention for behavior 
problems 

- c .Identification of learning modalities 

2. What is the likelihood of your implementing ideas 
gained from this workshop ? 

[J^J* What is the probability of your seeking more 
resource help? . 



Low 






HiKh 


1 


2 




4 




3 




4 




'. ■ i . ■ 


11 


1 :.' 


5 


4 


2 




2 


7 




1 


7 


1 


2 




£ 
O 


1 


■ . ■ 2 


1 


1 


6 


6 


1 












5 


6 


3 


2 


5 


6 


1 


Low 






High 




2 


10 




2 


5 


7 


1 








h 


1 


3 


6 


5 


1 


4 


4 


4 
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A - II, #27 INDIVIDUALIZED DESTRUCTION 

Learning Center Workshop 



Number of evaluation responses 6 



Objective s i 



To demonstrate the use of materials for individualized 
instruction*. 

T© demonstrate how to use learning centers for individualized * 
instruction* 



Population s 



Teachers, counselors, principal of Title VI site school* 
The staff of this school received continuous service from 
Title VI - staff 'and used Title VI resource materials, 

They participated in various workshops and were continuously 
involved with Title VI. 
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PRE . , ; 

LV: 1 How would you rate your willingness to participate 
in demons tratipna presented during a workshop? 

I . How, frequently do you make your" own instructional 
f:t V materials?^ 

yi Please indicate the level of individualized instruc- 
tion presently implemented in your classes 

$ • Which of these items are appropriate to your needs? 

Teacher made materials 
K% Commercial materials 

Equipment 

Staff resources 

5. Which of the following are major problem areas for 

you? Xv/ 
'Behavior 

Academic 
? Parent/school relations 
V Communication with other professionals 

POST ; 

L. What was your level of participation in activities 
during the workshop? 

2V How would you rate your receptiveness to increasing 
your frequency of material development? 

5, How effective was the planning and organisation 
V of the workshop? 

If, Show which of. .the following activities were a part 

of the workshop and indicate the effectiveness of 
- each by adding the appropriate number 

Panel^ p^sentatiqn _ 
: Small group discussion 

Lecture 

Demonstration 

Multi-media techniques 

Project assessment 

5. What is the likelihood of your implementing ideas 
; gained from this workshop? 
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mm . a - ii, #32 



Number of ©valuations from two workshops , 
1st Workshops 6 2nd Workshops 10 



'.'•t"'.i! : ! ' ' . 



Objectives g 



To train teachers to use instructional materials for individual* 
ization* 



To demonstrate the use of contracts in obtaining behavioral and 
academic objectives a 

To provide on-site consultation to teachers. 

To instruct teachers in making materials to be used in the 
classroom* 



Population : 



Regular and E.H. teachers and counselors at elementary site 
school* Staff received on-going help from Title VI resource 
teacher, consultants and participated in various workshops 
presented by Title VI * 



■ 



ERIC 
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A-II Target School Workshops 
? V;? "^ j^ Materials Day ; 



Sort of 
Possibly 
Yes Not sure No 



vl V Do you think you will actually implement ideas 
gained from this workshop? • ."• 

2. Did you take part in any activities during the 

3. Did this experience provide input which you 
." : ' find helpful? ^ \ ■ ' /' ' 

k 9 Did you see any materials you would like to 
; ; duplicate and use? 

5- COMMENTSs These types of activities very necessary; 

EXCELLENT IDEAS; excellent workshop, 
V especially the. work in the classroom 



6 
k 
6 



A«*II Target School Workshops 
#36 Materials Day 

1, Do you think you .'will actually implement ideas 
= . gained from this workshop? 

2* Did you take part in any activities during 
the workshop? """ ' 

3. Did this experience provide input which you find 
.helpful? : : 

4. Did you see any materials you would like to 
duplicate and use? 

5. COMMENTS: really appreciate What the demonstra^ 

tion teacher did; intend to use a lot 
of the ideas presented 



m 



ERIC 



;H:•.^^' ; I .:"::; v; ^'^^';'v^:J;•^v. 
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/ A - } II f #30 f ^0 , 43 TARGET SOTOOL WORKSHOPS 



Number responding to feedback 8 



Objectives ! 



To train volunteers in the use of informal assessment, self* 
concept » homemade games and materials for individualizing 
instruction for students with learning disabilities. 



Population ; 

.Volunteer tutors for individual children* 



146 



ERIC 
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A-II Target School Workshops 

#50 Upswing Presentation Materials*-Individualized Instruction 
#33 Individual; Programs Regarding Academic and Behavior Skills 
#^K) Presentation of Rated Assessment and Self Concept 
#43 Project Upswing Reading *« Rated Assessment 

Please respond to the following que s tions s 

1«V: Do you prefer to participate or observe demonstrations , 

1 1 participate in* « • • • • ■ * • • * * * • • • * • • ••••••••••••••• 1 

.2 * . . Observe *•#•♦#•*•••#»•■■••••••#»*■«* ##*•••••**•■• 1 

•* 3 * Both m 1 m * #■***••#•#••••*•■■**••• 6 

; \- . ; . .. Low 

2. To what degree has information offered in the work- 

shops been of use to you? 1 

3. VWhat gains do you feel you have made in regard to 

i understanding individual learning styles of students? • 1 

4. Please rate your ability to deal with behavior 
'problems ' ' • 1 

$♦ Have you made your own instructional materials- 

lv ^.Regularly • * * • # # • ■ * • •*••*»** » * » • • * * • * • • • » * ■*##*** 2 

2 # Occasionally • «##•*• •*•*•••••••«««*««•#•••••••• 4 

3* Very seldom* ••••••••••*••*•*****•*••*••••••***** 1 

6, How would you rate the effectiveness of games as 
; leaning tools? ' • ; . ' 

7 • How would you rate your ability to tutor for 

specific learning problems? 2 

8* How much resource help have you received for 

students with learning problems? 1 

9* What types of additional workshops would be of 
interest to you? 
Responses; .creativity; in classroom; behavior 

problems; how children learn to read; 
terms of learning disabilities 

0. Please rate the overall effectiveness of the 
• > workshops you attended 1 



A * II, #38 OWJMTATION M^TDJQ FOR H, WONG WORKSHOP 
Multi-Media Happening 
. >: Number of feedback sheets 55 



Objective s . 

Demonstrate techniques to use in motivating uninvoived student 
In classroom* 

Provide communication between regular education and special 
education in respect to specif io learning problems. 

Demonstrate the use of science concepts in working with 
uninvoived students* 



Population s 

Teachers, ancillary staff t supervision from District Office. 
This workshop was given by a Title VI consultant and was 
designed to promote eoraaunicatlon between teachers and 
ancillary staff, 
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iA-II Target School Workshop 

#38 Orientation Moating for H. Wong Workshop - Multi Madia Happening 

ijl* Do you prefer to participate or ob serve demonstra* 
tions? 

i-v 1. Partioipata in* #*•♦♦••*•*••••*•***••••••♦•• 5 . 

2 • Observe * *##•••••****•■***«•******»**«•***** 

20 



3* Both. « • » # 



2. To what degree has information offered in this 
presentation been of use to you? 

3, What gains do you feel you have made in regard to 
■understanding individual learning styles of students? 

X* Please rate your ability t© deal with behavior 
problems 

5* Have you made your own instructional materials? 

1 # Regularly, .*•••••»• 1? 

2 . Occasionally* * * • • • • ■ ^ 2 

3* Very seldom* ••*••«•***••*•##* 3 

■6. How much resource help have you received for 
students with learning problems? 

7V What types of additional presentations would be of 
interest to you? 

Special education and general education cooperation; 
learning disabilities; reading; math; engineered 
classroom; resource room materials; behavior problems, 
- etc . 

8. Please rate the overall effectiveness of this 
; : presentation 

^9. How would you rate your reoeptiveness to having a 

consultant work in your own classroom or school? 1 1 5 2 2 



Low 






HlRh 


1 


2 


3 


4 


0 




7 


2? 


1 


5 


11 


14 


0 


4 


17 


10 


7 


8 


9 


3 



0 0 8 25 



A - II , #39 



CURRICULUM RESOURCE DAY 

Number responding to feedbacks Pre l6 f Post 7 



Objectives i 

To train teachers to use instructional materials for individual- 
ization m 

To demonstrate the use of contracts in obtaining behavioral and 
academic objectives. 

To provide consultation on-site to teachers for programming of 
children with learning or behavior problems* 

To instruct teachers in making materials for individualized 
instruction, 



Population s 

Regular classroom teachers, E»H. teachers f counselors » principals 
the ancillary and administrative staff* 
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A-II Target School Workshops 

09 Curriculum Resource Day 

PRE 

1 # Wha.t types of workshop or inserviees do you have 
J.y : --'kn-- interest in or feel a need? 

record keeping; self concept; contracting; learning 

center materials ; training paraprof essionals ; 

individualized instruction - reading and math; 

science; metric system; activities for remediation 

of reading, etc* 

2, Do you prefer to participate in or observe 
demonstrations? 

1 • Participate in* ■*#*#***••**■#■****••#** ******* 1 
2 • Observe ?********■**•****«■•»**•**••***■•■*#**• 2 

5 * Both a***************************************** 17 

5, How frequently do you make your own instructional 
materials? 

1 • Regularly ********************** *•••***•«•*#•■« 11 
2* Occasionally* •#••■:•••••••••••••••••■••••»••■•« 3 

3* Very seldom* ••••••••••••**•••******■«••*•••••* 1 

4. How would you rate your receptiveness to increas- 
ing your frequency of material development? 
1 • High ****•*****•**•*****•••***•••*•••#*#*#***•• l^f 
2 * So^so *****••••••••**•*•**•******»******•■*•••■ 3 

5 • Low #■*•••*#•*•*«*•**••••*******•■*••*••*» 0 

5* Have you ever used learning centers in your 
classroom? 

ITes *** *********•**#****#*****•*«««••*■*•••••••••* 7 

No ****#****••*••••••••••••••••••*•■••••##•******* 0 

Occasionally* **••*••••*•••*••••*•**•#•«•••••*••** T 

POST 

— 1,-1 ~ *- 

lv Do you think you will actually implement ideas 
gained from this workshop? 

2, Did you take part in any activities during the 
workshop? 

3* Did this experience provide input which you 
find helpful? 

4* Did you see any materials you would like to 
duplicate and use? 

5* C0I#ENT3s very good; need more of this kind of activity; 
many good ideas; same materials used for various 
levels; liked the time to make materials; M a shot in 
t^ arm; ff 

6. Name one item you would like to have us provide for you* 

materials; ineervice for complete 
^ facilities ways to use the same materials 



: 

V'vv. 



A P P E N D I X F 
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\ WORKSHOP NUMBER 



Appendix F 

NQN-GDWIBRCIAL MATERIALS USED IN WORKSHOPS 

A I A II 



'file FOLDER COMPUTER 



IoRIENT^ION TO THE EJV^N»3T 17 

^^IVIDUALIZDJG EDUCATIONAL GAfffiS 9 • 10 . IX 

^ NORTH, SOUTH, EAST AND WEST 9,10,11 

^DOMINOES 9,10,11 



" *Item included as a sample of non-commercial materials. 



^IBJITIAL CONTACT SffiET 12 , 45 9 

IftJQR GOALS FOR TEACHERS AND CHILDRM X,X2 9 

^EAGIffiR PARTICIPATION REQUEST 9 

A WAUt IN ANQTJffiR PAIR OF SHOES 12 

|THE ANB4AL WORLD 12 

^^ORMAL OBSERVATION OF XJ1ARNING MODALITIES 12 

PRINCIPLES OF BEHAVIOR MODIFICATION 2,5,6,7,8,14 

%TME COMMITMENT 2,5,6,7,8,14 

"■OBSERVING CLASSROOM BEHAVIOR 2,5,6,7,8,14 

CLASSROOM EXAMPLES OF TARGET BEHAVIOR 2,5,6,7,8,14 

-GROUP DISCUSSION 2 ,5, 7 #8,1 4 

SUBJECT MATTER GROUP MEOTING 2 ,5,7, 8,1 4 

STUDY GTJIDELBJES 2,5,7,8,14 

GAME GUIDELINES 2,5,7.8,14 

^GAME GUIDELTOES, eont* 2,5,7,8,14 

"INDIVIDUALIZED PROGRAMMING 2 f 5,7, 8,1 4 

INDIVIDUALIZED PROGRAMMING, cont. 2,5,7,8,14 

^OBSERVATION CHART 2,5,7,8,14 

OBSHWATION CHART, cont. 2,5,7,8,14 

WORK RECORD CARD 2,5,7,8,14 

IbCSE M^TTOS REPORT.-. ^*13 

ifuiiading-daily sequence checklist _ 4,13 

1 strand 5 s visual skills 4,13 

Becoming familiar with the sequmges 4,13 

mm ARE A WINNER 6,20,26,35, 8,40,42,49 

(MME CARDS FOR ABOVE 6,20,26,35. 8,40,42,4 9 

SELF-CONCEPT D3VENT0RY 6 , 20 , 2? 1 55 » 8 , 40 , 42 , 49 

45 



6,9,10,11, 16,29,49 
40,45 



-REINFORCED USING THE DOMINO GAME 9,10,11 

HEX 9,10,11 

^ INTERVENTIONS. 17 

TAKE OIK HATS OFF 24,26,35 

. FEELING GROOVY 24,26,29, 35 

PEELING GROOVY, eont » ' 24,26,35 

. CONFIDENTIALLY I THINK 24,26,35 

HEAR YE, HEAR YE 24,26,35 ; 

YOU SHOULD BE FEELING GROOVY v'' ' 24,26,35 

CONTRACT - SCIENCE 24,26,35 

| INDIVIDUALIZED SPELLING PROGRAM 24,26,35,45 

?|!mAKING IT WORK AT THE OPERATIONAL LEVEL 26 

. RESOURCE ROOM PROGRAM 26 

SSROBERT LOUIS STEVENSON-RESOURCE ROOM 26 

-TITLE VI-G RESEARCH TEACHING 26 

CRATED ASSESSMENT DJSTRUCTIONS , MATH 26,35,44,45 
|fRA^D.MATH : , '^hr^ 26,35,44,45 

RATED ASSESSMENT INSTRUCTIONS-READING 26^35,44,45 

| RATED ASSESSMENT: - READING 26,35, 44, 45 

'■S SWCB YOU, , , 26,29,35 

$ BEHAVIOR' MANAGEMENT * 26,29,35 

| ; CONGRATULATIONS 26,29,35 

-GOOD GRIEF i I 26,29,35 

THESE ARE 26,29,35 ; 

SNOOPY DAY 26,29,35 

V CREDIT UNION ' 26,29,35 

.SAVINGS BANK 26,29,35 

ifSTTOENT- BANK ACCOUNT 26,29,35 

'^FEEDBACK COMMUNICATION TELEGRAM 26,29,35 

§EArERYBQDY ,f S BANK 26,29,35. 

THESE ARE NOT, , , 26,29,35 
i AT RAPHAEL WEILL < 26,29,35 

•'good show! fun, fun 27 

j ; smorgasbord menu 27 ,28 

||i£arning7contraot 29,45 



- : ATTRIBUTE BLOCKS 

CHIP TRADING ACTIVITIES 

PILE POLDER WOTBOWS 
|OT)IVmtmLIZ^ EDUGAHOmL GAMES 
I ANSWER-FLIP-UP 
= MILK CARTOON : DICE 

LET'S PLAY COVER-UP 
S COVER PAGE FOR; EVALUATION 
pf^OJUffllCY ■ OF BEHAVIOR 
B^lpiWYlOE ' BEHAVIOR OBSERVATION 
If CONTRACT COUNT 

^.K^.v^W; : %;<--,?^^:-'...--.- ;■ ; . . • •• 

^STUDENT BEHAVIOR REFERRAL 

;;;>ARTiCIPATION REQUEST . 

I CONCENTRATION 

; TWENTY QUESTIONS 
PART I |v : -; ; ^ 
/METRICALLY THINKING 

* MULTI-LEVEL DITTOS 
^ADDITIONAL WRAT INFORMATION 

TANGRAMS 

• HOW MANY COLORS 

^COMPREHENSION-RETENTION MODALITY TEST 
^THINK METRIC 
t; MY FINGERPRINT IS MB : 
//MY PHYSICAL CHARACTERISTICS 



40,45 

40.45 

40,45 

40,45 

40,45 

40,45 

40,45 

^5 

45 

^5 

45 

45 

45 



16,29,49 
49 

16,29,49 
16,29,49 
16,49 
16 

29,49 



16,49 

49 

47 

47 

47 

49 

3 
8 

8,27 
12 

15,26,47 
19 

19 ; 



•-' " ■ .,: --■ 

■ A I A II A III 

^ ... _ , , . 

* READING TIME SHEET 27 
W NEW. VOCABULARY SHEET 27 
^LEARNING CENTERS r 27,49 
^LEARNING CENTERS FOR CLASSROOMS 27 

il ^LEARNING CENTERS ? 27 

* IF YOU WANT TO CREATE MATERIALS 27 
'MY NAME 27 
WORD BATTLE, COVER UP 27 

1 1 CENTER SHEET 27 

: CENTER SHEET, eont. . 27 

* V PHASE III s SMORGASBORD SERIES 38 
^AWARDS - DESCRIPTION, PREPARATION, AND USES - 49 
? MULK-FUNCTIONAL WORKSHEETS 49 



litem included as a sample of non-commercial materials. 
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. • I - 40, 45 

II - 16, 29, 49 

TMnTvronALigmG i mmummL QAMBS 

1. Even though you know how to play the game - look at the instruction before 

you start to play. *.„ A +>„»« 

2. you »d your .Mid Bay 1«» a new Ml you Play a ffo. togattor. 

3. General Instructions: 

Before you start a game, remember these three points - 

» Ask your child only once a day if he wishes to play a game, 

b. Review rules before playing - if ^e child wishes to change a rule - 

which makes sense - make it a part of the agreed game, 
c Set a time limit - stop at that time so that the child and you 
„U1 not lose interest - but rather will stop when interest is 
. high - varies 15 to 30 minutes - 30 

4. Verbalization is Important part of learning any new skill - 

a Use specific words when preeenting toe instructions, Try to teU 
the child exactly what you want him to do - check put to find if 
the child understands clearly what you expect. 
Examples: 

i Place the ehips in a stack to, your left. . . . 

* Sther than: Don't scatter the chips all over the table. 

p K^eD the blocks on the table, 

* Sther than: We don't put blocks in our mouth, do we? 

3 You have some blocks. You keep those blocks and let him 

Kh£\Z£T you like to share your blocks with him, 

k. Walk in the house. 

Rather than: Don't run in the house, 

5. You push the table and I'll pull it. 
Rather than: Don't hurt yourself. 

6. Take turns. 

Rather than! Be good 

7 . Follow the directions. Play after the other player finishes. 
Rather than: Play nicely 

b Use specific words to tell about position, 

Example: The pegs are on the bottom shelf beside the puzzle. 

Rather than: Right over there 
c . Use speoific words to tell about position 

Example: We will stop at 6:00 

Rather than: We will stop after awhile . 
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MULTI-LEVEL DITTOS 



Multi-level dittos can be used both for individualized instruction and with 
group instruction* In using multi-level, please remember to provide f or the 
individual differences of the students you teach * 

Soma ways to use multi-level dittos s 

A* Individualized instruction* 

1* A certain number of words or problems can be given to an 
individual student depending on his capability, 

2, A certain task can be designated on individual basis - Example 
A group of students may be using a particular multi-level 

i ditto using words; however, an individual student may be 

working on words from spelling social studies, reading, etc* 

3. Additions to assignments done with multilevel dittos can be 
assigned oh individual basis Example; After completing 
task assigned on multilevel dittos, you may have a 

ehoise of 1, 

2, ' .. 

5* 

;. : •v/-.:: : ; ; /--: ; : i '\:v"^'\.-^\; ! ;" : ;. • • • ^ • :: : ; 

B# Group instruction* 

1 . The groups can use multi-level dittos by using different 
assignments on same ditto. 

g, Groups can be assigned to same assignment on different ditto, 

3* Groups can work on other projects using multilevel dittos 
as a part of project. 



EH Model Project, Title VI-G 
10/73 



225 



II - 3 



Additional W,R,A#T. Information 

?Ehe Wide Range Achievement Test will be more valuable if the examiner alertly 
tunes into the student's behavioral and mechanical processes* The frllowing are a 
few suggestions of additional information that can be gathered when giving the W#R*A,T, 



> Advantages 
1. 

, 2. 

t:'. ,. . '3. 



The W,R*A,T, is the second most frequently used instrument in tea 
reading by school psychologists and reading clinics. 
It is easy to administer and score* 

Then .-are' no 'contextual or picture clues as in .paragraph reading* 
The range of ability is from nursery school to college, 



1, It provides only a rough grade placement* 

2, With a range from nursery school ta college, it is obviaus that the 
number of items per grade is limited and the number af pupils per grade 
en which it h£S been standardized is "likewise relatively mall* 

3» It provides ne measure of word comprehension, A child may pronounce the 

word correctly but not comprehend it* 
4, The standard .scores and percentiles are subject to question. 



Bohavior 



1, Check how the student balds his pencil. Is he tensed or relaxed? Does 

he have difficulty forming numbers? (This can be behavioral or mechanical,) 

2, Does . the student subvpealize vhe4*hfc works problemj? How dependent is 
he uppn verbalization? 

3* Hw dpes the student use his non-ftritiiig hand? • 

k* H*w jl^es the student approach arithmetic? Does he give up easily? Is 

he enthueiatie? 
5. How. does -toe student deal with failure? 

i, How\well does the student use hie time? If it is difficult for him to 
finish a problem can he move onts the next prablem after a reasonable 
amount of time? 

7, Does ha give wild answers (an attempt 'to hide inafteqjaaeies)? 



^ Meohaslfes. in Arjthmet&j 



1, Dees the student use concrete count Jjig aids (fingers, marks, etc,)? 

2, Does the student confuse place value when writing numbers? Does he line 
up answer correctly? 

3, Does the student carry the right number? Can he remember a number for 
iraaediate use? 

4, Does the studenb cenfuse processes? Adds when he should subject , etc* 
Is h© aware of written instructions ? Haw closely does he attend to 
details? 

5* Dees the ftudeht reverse, „ invert t or transpose numbers? 

6, Dees the itudent need more than the available world.ng space? 

7 , Does he h^ye difficulty going, from an addition problem to a subtraction 
problem? Does he tend to repeat numbers that he has already used? 

8, Does he tei^d to work" from ^^t left (directional confusion) ? 



V *R *A *T * Information - page 2 



Mechanics In Spelling 



1 * Poor handwriting (visual-motor incoordination) • 

2# Small , cramped handwriting (a withdrawn or constricted personality) 
3. Poor spatial organisation M alignment of letters (visual-motor 
inoo^rdinati^n) • 

k* MsspaLling Ms ovn name (poor attention to de tails , immature visual 
perception;* 

5 • Reversed symbpis, letters or words, such as "doy" for "boy" (directional 

confusion^ tamatwe visual perception) • 
6, Confusiori $f letters which look somewhat similar, such as "m" with "n" 

(immature visual perception) ♦ * 
7* Poor sequencing of letters within words, such as "wacht" for "\mtoh" 

(poor visual or auditory sequencing ability) # 

8. Punting down the last letter of toe word only, such as "m" for "him" 
(poor auditory memory and sequencing ability) • 

9. Ability to spell, phonetically but incorrectly, « such as "nacher" for 
"nature" (good auilfcoxir se\md*to*ei2mbol abliafcy but poor visual memory 
of the correct spelling) » , 



Mechanics in Reading 



1* Rot "saw" for "was", "dig" for "big" 

(directional confusion; immature visual perception), 

2. Vw sequencing of letters,; such as "flat" for "felt" (poor visual ; 
sequencing) • 

3. Missing the inner details of words and guessing by the beginning letter 
general shape, such as "black" for "bleck" or "little" for "letter" 
(poor, attention to details ; immature- visual perception) • ; t , _ J, ; , _ 

4. Confusion of vowel sounds, such as "jer" for "jar" (poor knowledge of 
vowel sowds)» 

5. . Child reads significantly better on word lists, such as the WHAT Reading 

■ ■•■ eyibtsst , than he does diriparagrax^\ reading (imnature, .visual perception? || 
figure-background disturbance where child is distracted and oonfused by 
additional visual stfcnuli) • ' " V 

6» Child readd ;,siffiifieantly worse on word lists than he does in paragraph 
realing (heavy reUanoe on contextual and picture clues) » 



Dear Parent, 



....... ■ ■ 




illustrating and binding his/her own t book. 



has worked very hard in planning f writing 9 



t , We fare interested in your reaction to the idea and the finished book* Please 
jf (fill out ^ the following questions * Check one box under each letter . 




I knew 'oy son/daughter was writing the book because he/she 
told me about it. '\::*-'- : A-v : ^ : <( 'i i£ • • ''£;>•}':':<■ - i> ^ : . : ' "-Y'J . ■ ' 



I did not imow the book was being written 



1 I am proud of the efforts made 
I am not proud of the efforts made 



j I want to show it to other members of toe family 
I will not show it to ether members of the family 



; READIN3 : SHEET 



Keep track of the time you spend reading*^ 
Record the time you start and finish daily. 



/(TVS 



II - 2/ 



> 8 3 Wltilrir poo KS 1 



^ BATE 


TBflE STARTED . 


PAGE 


TIME FINISHED 


PAGE 


COMMENTS 

-— -JUL" ■ - >.ii.n.i I „ii-««ui.4^:- — 






: T i~ i i iiiiiB i 
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IP YOU^ W^ MATERIALS, YOU . 



a, workbooks or other sources of pictures 



b* magic markers 



rubber cement 



d* clear contact paper as a protective 
coating for the surface - laminating 
film also works 



e e tiny toys to us© as markers 



f . flash cards 



g. dice or spiwier 



tu scissors and ruler 



i» card - various sxms 



0 > : : -. K - } - ; 



S Title VI-G/VI-B Research Teaching Project 
^Potrero Hill Junior Hi^i School 



jSlp^jHaro^Street 

E RiC afsi^ ,647- 
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Description t Preparation, and Uses 



o 



ie cflretu worm 

OUJOtd presented t< 




AN AWARD IS A WRITTEN 
C0OTL3MENT INDI^ATIN^ 
ACADEMIC GROWTH OR DffROVED 
BEHAVIOR 

Awards should 

specify individual being 
complimented 



state specific nature of 
the compliment 



provide a place to identify 
sender and/or witness 



Tho choice of illustration?] and sophistication of language will 
depend upon the ago and inter.ists of the consumer (students). 
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" Awards- dome Aft varieties 

receiver has hmii oandr\dly caught in the act of doings 
something apyblal : ; Tho snsJl ^orasthiijg vsps^als i^ay b - 
related to Aoad^mrlo /gains ,•• n s ;iore ;:,scd positive tichavioru » 
decreased occurences of midair ed bdhnviars f -/or acts of 
human support* V' . T 



oh indicates rihat tJfeo • 



Sma32; steps toward dooired 
•behavicrs E.re notices [■■'", 



Kult.L-purrosa av:a;; da aro open-; 
endad and o;\n bo used an ncsded. 



For not bugging an^on© 
during y 



ha.'j ocrnec". 



toda^ 



You have 'osi" earned | 

i ... .l j. |. 

an exlra bonus poivu hyi 



I)/ 



7 sj 



Kolpizis a friond, or in scr:^ 
way rcaahi^j out to another 
human bojlnj can enc cruised 



\ Tour Tola! ICm mcmm 



- W 

.11 vjhon \° , 



looked thio ta 

yon holTRstl - 




e/vlrq point 




fir. i.nzniu U'-'O'::.'-::^ r\r.y bs raco£fii£cd 



i , 1 00 are. 1 



is 



hump 



w 



j if ¥p 

f «i' -'- J 1 j 

k 



^4^1 ^fU, V s 



1^ Dats 



/ /<^rklk,„ 



^11 
■ **• 



-1 



-■■■■I':. 

■ -:\ 

11 



:RJC; 
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WORKSHEETS 



Description f Purposes , and Uses 




Title $A ip 

Tell about the f 11ms trip 




Did yeu like it and. whyi 
Vg^ bee aQ$& j t~ & 



What did you learn? / 



•Make a picture report* . . 



u 

A 




8 



•3ohir) $j 



3 



Student 



Date 



imTO-FUNCTIONAL WORKSOTTS ARE 0PM 

Isded, mqtxvatbjg, mom woRKsaras 

WHICH CAN EEs ; .. . 

1, USED MORE . THAN ONCE WITH A 
GIVEN STUDENT OR, 

2 # USm tOTH A:OROUP iOF,STUDHraS 
IN DIFFERENT WAYS DEPENDING 
UPON THE, STUDENT 1 S CURRENT : 
mSTRUCTJONAL NEEDS * y 



8^3 




jE2 





ERlCii 
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Multi-functional worksheets:- ... 
, 1. allow teachers to individualize their programo as desired. 

2. encourage students to approach psneil and paper tasks which look 
interesting; and appealing. 

3. provide a relaxed format to foster better eemBunication between 
people (big and little) who share a learning environment. 
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lie of ior ilays i 



THE PUPIPSEEnO^ 



SAN FRANCISCO UNIFIED : SCHOOL DISTRICT 



i^^f:^^?:,:!:; ::yS- yV. v-^ v ; :• y V. ; .. /y r yi :.y;Vy.v. . ^y'K^.-h:^ >y ; 

Hit'.:. ^ V ' - ;! .,. ' 



y.'i ■ : '■: ' 



IPS 



"goring and operationalizing skills of Pupil 

C Service'worksrs as' a baais for future sharing of 

;yyy:::vv:-y: • ; , 

SI? knowhow between Special and General Education staffs, 



■■■IV ; V. « i.,V,i 



IS 
B:,i'v:y 



PHASE 1 - Smorgasbord y- ■ .Two iesiions; , 
iy^^a#iyfe Dec. 9th (9=00 - 12K 



ition'Orffit^ 



■ Plaoi i'Potrero Hill Junior High Sahool 
■ : . : 655> De Haro ■ 3 trset^ ■ ; y' > : 
#•>;• ;y •*Saa';Ftanciigo, ; Calif ,y ; v 



|§y PHASE II Mlowup with ongoing inservice in.the 
W:m^M'M^ [ ^^^ "Wtfi'iiniril eduea- 

■y'V; '-, tion stiffs, ' : ■ ■ , • ■ " ;/ , y ;;: 



^• : yr : ^ 

y W . 
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CHOICES- 



ffieri are ;8 ointirs ^dsseribed aiwi located on : ^our 
menu, Choose ) of tlie 8 centers for participation 
during B, C, D, - timi slots : ■] • . '»'•'_}"' 



SC1DUU 



Thursday, ; Dec. ;|th; - 4:00 to ? 1 00 Piin, t i m . . ^ 
y ; ^:00 - 'i;13 '.•e^istJ-Etion ■ , 
A ; 4ilQ - 4i4o Mekoff Session (Or, Gerald Vest) : ''y 

B * choose 1 center for each time 
C 5i25 - 5-55) n1nt ■:'^ ; -' v: ;' '^ 

D : J 6i0d -:6s^)) : : ' r '- : sP;v::::Sl 
E 6133 - 7:00 Evaluation and rap up (Don Cross : 

(Dick Robbins 
(Joyce Kohfaldt> 



SateJay , Dee, 9th. 9:00 tolgiOO , 

9;0C -.9:1" .'iiiiistration . ; - ir&i 
A 9:10 - 9j 1 K5 , Eckoff (Dr, Gerald Mst) ; '- 

B 9i50 ; - i0 |2 0 p ) choose 1 cinter for each time ; : M. 
C 10:25 - 10:55) sbt " ^ 
D iliOOUliJO) V M 

E • H;35 - 12:00 Evaluation and rap up (Don Cross -y. 

y ( Joyce Kohfild: 
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»1| 
Education . 



Room 



Pirtieipantj Marjorie Good^ 



Rocs 



rPSrtieipaiits:. Ann Garfield ■ 
" ' " ; Sandra Dragin ■ ■ 
: Brunilda Heilbren 






Room 




Participants i Muriel; Tarnapol 
■ Johanna Petersen 
. Jane Crinir ' 







Participantsi Sharon Regalado 
! Gwen Owens 



2 J A 
Ail''' ■■■■'•■■;<*: A ^ 



t':V/ : "... " L ' 



'CO 




fuH'N <f ■ W 

6^S 




Room 



Participants; Betty Thomas 
Beverly Cohen 
Diane Onorato 



Ream 



Participants; 

Carlos Cornejo 
Elaine toady 
Juinita Smith 




Room 



PartiDipintS! ■ . 
Carol Lee 
Mary Crosby 



Room 



Participants s 
Maroia Anderson 
Dorothy Rosenberpr 
Susan Ltidy 
Josephine Carpipano 
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RESEARCH'. TEACHING PROJECT 



A public school model Service Center providing prompt 

analyais of learning disabilities » intensive specialized 



teaching, support to parents and re gular teachers t and 
practicum to specialist teachers , 




California State "Department of Education 
Division of Special Education 
Capitol Mall 
Sacramento , California 

San Francisco Unified School District 
Special Educational Services Division 
135 Van Ness Avenue 
San Francisco, California 
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t: 'h' SAN FRANCISCO TITLE VI -G STAFF 

Project Head: Jane Anderson 
Field Research Teachers s 

f ; : An§r Eggers Betty Thomas 

Kathy Shiinizu 

FTJMi n I Left My Heart in San Francisco" 

(Courtesy of San Francisco Tourist and Convention Bureau) 

OVERVIEW ; Title VI-G 

SHARED RESPONSIBILITY i Staff Presentation 

Question and Answer Period 

» 1974 Year of Dissemination and Replication " 
Slide Presentation 

CENTERS 

You will have the opportunity to attend two 4 centers of your choice 

MAKING IT WORK AT AN OPERATIONAL JMVMj 
Amy Eggers 

To present and discuss establishment 
of two Resource Centers as an out 
growth of Title VI-G. 

mTERlALS FOR mpIVIDUALIZBJG 

Betty Thomas and! Kathy Shimizu 

To share materials developed by Title VI>G 
for individualizing instruction in both 
T ; regular and special education classes, 

RATED ASSES SMENT AS AJEQOL; GMmS AS AN P1TERVMTI0N 

Jene ^Anderson 

To provide^ an opportunity' to use Titlel¥I-06s Rated 
Assessment as a tool for programming activities^ 
using educational gMias, 

(Materials Courtesy of Tom Wiseheert, 
Audio Visual Services) 
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PHASE IE SMO.RGASBO 

SERIES 
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SMORGASBORD SERIESi PHASE III 



TITLE i DEVELOPING THE LEARNING TEAM CONCEPT FOR SUPPORT AND TEACHING 
STAFF AS A MEANS OF MAINS TREAMING PROGRAM FOR THE INNERGITY CHILD 

PURPOSE sto extend the learning team concept of shared responsibility 
Ijefwelrf teaching and support staff by providing opportunities for 
continuing communication in a learning environment. 



TABLE OF CONTENTS i ' 

May 1 ORIENTATION MEETING I MOTIVATING THE EDUCATIONALLY UNINVQLVEB 

Potrero Hill Junior High School and Teacher Learning Center 
May 7 ESP WORKSHOP; EXPERIENCING SUCCESSFUL PERFORMANCE 



For Impact Teams at Intermediate and Secondary Level with 
Followup Consultation with Harry Wong and Title VI Staff 
May 13-17 and 27-31 

May 8 WHAT'S HAPPENING IN LEARNING DISABILITIES 



Sheraton Palace Hotels five presentations, each presented twice, 
once in the morning and once in the afternoon. Each participants 
therefore, chooses two of the following sessions s 

EVALUATION DESIGNS 

THE RESOURCE ROOM 
LANGUAGE DEVBMPMENT 

CURRENT TRENDS IN DIAGNOSIS 

ADMINISTRATION AND TEACHERS 
May 28 FOCUS ON PRIMARY EDUCATION 

Teacher Learning Centers With Joyce Kohfeldt and Title VI Staff 
THE SMORGASBORD SERIES s BACKGROUND INFORMATION 

NOTgs Independent Study can be arranged by signing up with "Special 
Classes and Itinerant Services' 1 during the Signup Period following 
Harry Wong's presentation. 
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ORIENTATION tTODIG May 1^ jg 1U at 4sQO FM 
Fotrero Hill Junior High School 

Juanita Smith 
Elementary Counseling 

Ifcrn Kelly, Supervisor 
District Inservloe Bduoatian 

MOTIVATING THE EDUG AT I0NALLX HANDICAPPED Harry Wong, Guest Speaker 

ABOUT HARRY WONOi he is teacher, textbook author, and direotar of a curriculum 
prajeot far the educationally uninvolved, He Is In much demand as a speaker, 
already booked into 1975. His presentations often end with a standing ovation, 
His is a dynamic presentation expressing concern far and strategies for dealing 
with the uninvolved student* Jfr* Wang is a practicing eiassraam teacher and 
direotar af the IDEAS AND INVESTIGATION IN SCIENCE PROJECT, His message, hawever, 
Is equally applicable and relevant to all disciplines and grade levels." 

AT 6:00 PMi 

SMORGASBORD FOLLQWUF ACTIVITIES Jane Andersan 

Title VI-G Project Head 

SIGNUP TOR SMORGASBORD ACTIVITIES 

1. May 7i Intermediate and Secandary Levels Jane Andersan 

Betty Thamas 

2. May 8s What's Happening in Learning Disabilities Elaine Walfe Grady 

(Open to 25 persons in each of 5 groups) 

3. May 28 t Primary Education A^y Eggers 

*4* Special Classes and Itinerant Services , Jane Criner 

Marola Dunn 



Mistress of Geremanies 

THE SMORGASBORD SIRXE3 



*Those signing up for the fourth activity will be involved In independent 
study using an approach to working an the aspects of mainstreamlng as this 
applies to Special Education classes and itinerant services, Those who are 
Interested may wark as an independent team or elect to coordinate efforts 
with a larger group* 

Marela Dunn 928*7477 Jane Criner 863-4680 

■ Ex, 287 



CHINESE CUISINE at 6s30*PM at the Teacher Learning Cent< 

1400 16th Street 
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ESP WORKSHOP I EmmiENCING SUCCESSFUL PERFORMANCE FOR IMPACT TEAMS AT 
immmDUm AND ffiCQNDARY LEVEL ffay 7, 1974 at Teacher Learning Center 

9:00 AMs this session* conducted by Harry Wong* is a first step in the 

to developfient of work strategies for teams composed of support and 

3i00 PM teaching staff* Mr* Wong will be aided by the following Title 
VI staff members i 

Jane Anderson 

Marion Miller 

Any Eggers 

Betty Thomas 

Kathy Shimlzu 

Vie Milhoan 

ARMS TOR BMPHASIS* 

1* How to achieve a 95% Success Factor in the Classroom 

2m Use of Contracts 

3# Reducing the Dropout Rate 

4* Techniques for Teaching Relevant Major Concepts 
5* Importance of Teaching Styles 

6, Developing Positive Self Concepts for Teachers and Students 



POLLOWUPl 



Onaite consultation with Harry Wong will be available upon request 
during the weeks of May 13-17 and 27-31. Its Wong will work with 
both teachers and students In a learning context. 
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WHAT'S HAPPENING IN LEARNING DISABILITIES 
May 8. 1974 at the Sheraton Palace Hotel 



9»pP-lQxpO AM 
Greetir 



Charles Keastar, State Department 
Special Education 



lOwview of California Title VI Learning Disabilities Pro jeetss input 
|from staff menbers from other areas within the State 



10:00-12100 

and 
1:30-3*00 



SMALL GROUP MEETINGS i each of the five sessions listed below 
will be presented at the aernihg and the afternoon session. Each 
participant will, therefore, be able to attend two of the five 
sessions listed directly below: 



1 . EVALUATION DESIGNS 



ERIC; 



2. TIE RESOURCE ROOM 



3* LANGUAGE DEVBLOPlffiNT 



L . CURRENT TRENDS IN DIAGNOSIS 



5. ADMINISTRATION AND TEACHERS 



fergaret Scheffelln 

Ualirornla btat© XJepartment of Edueatlen 
Sacramento, California 

Dave Ualan 

?S3eo^^ffreotor f 8y etewatic Program 
Development for Educationally Handi- 
capped , Sacramento, California 

Joto® KoKfaldt 

donaulian'G ror Leadership Training 
Institute, San Francisco, California 

Lee Wlederholt 

Leadership draining Inatltute 
Departs&nt of Special Education 
College of Education, University of 
Arizona, Tucson 

Phyllis Newcomer 

leadership framing Institute in 
Learning Disabllitie a , Department 
of Special Education, University 
of Arizona, Tucson 



Donald D . J f anmi ll 
ReaearcTfier"' 



Tens 



Harry Overlina 

Associate Professor, California 
State University! Hayward, CA# 

Jays MaCart^y 

^eaaersnip Training Institute, 

Department of Special Education 

College of Education, University of Arisona 
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Joyce Kohfeldt, Consultant, will be the workshop leader and 
will be aided by the following Title VI staff members! 



^OCUS ON PRDiARY EDUCATION tfay 28 1 1974 at Teacher Learning Center 
9i00AM 
to 

3s00 PM Asy Eggers 

Virion Miller 
Marilyn Stepney 



PURPOSES to plan for onsite implementation to begin May 29 , 30, and 31* 
111 B " w " The areas to be covered are teaeher-made materials, contracts, 
rewards, learning centers, resource room, learning games, self- 
concept games, individualized instruction, and inventory. 



a basic working onsite plan for us© at those schools 
represenxea Dy "participants will be developed at this initial meeting. A 
part of the day will be glv«in to a consideration of alternative approaches 
designed especially to meet the needs of Individual participating schools, 



* Joyce served as Title VI Project Head during the 1972-1973 school year 
w& Phases I and II of the Smorgasbord Series were planned and 
as part of the Title VI Ineerviee effort during that year* 



implemented as part 
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THE SMORGASBORD SERIES 

BACKGROUND i In the fall of 1973 the Project Head for Title VI-G reported to 
the Supervisor of District Inservlee Education that msnerous requests for an 
Integrated inservlee operation were being received from parsons representing 
the various ©esters within Special Education. These requests expressed a need 
for Increased communication between Special Education Staff and between the 
General Education aid Special Education staffs* 

A Planning Oomittee called The Pupil Service/General Education Staff Develop* 
ment Oomittee representing the named areas, the Project Head for Title YI-G f 
and the Supervisor of District InserviQe Education attended a series of planning 
meetings beginning In the early fall of 1973* The outcome of this planning was 
a two-session workshop called SMORGASBORD, designed as follows I 

PHASE I 

Purposes exploring and ©perationaliglng the skills of Pupil Service workers 
as a basis for future sharing of knowhow between Special and General Educa- 
tion staffs. 

Places Potrero Hill Junior High School Time! December 7 (4i00*7i00PM) 

December 9 (9 f 00-12 f GO Noon) 

Formats 8 Input centers scheduled so that 3 could be experienced each of the 
two sessions. At the close of each session check lists were completed which 
indicated which area participants would like to explore in depth for PHASE II. 
A video-tape documentary was made of the entire operation (27 minutes). 

PHASE li s A majority of the participants indicated that they would like to 
explore in depth two of the original eight input sessions. The two chosen 
were MANAGING LEARNING ENVXRQNJffiNTS and DIAGNOSTIC TOOLS. 

PHASE Ills 



GOflki to extend the learning team concept of shared responsibility, between 
teaching and support staff. 

OBJECTIVES? 

- 1. to organise an orientation meeting designed to extend awareness 
amorig support and teaching staff of the need for communication 
relative to the learning process. 

2. to organise teams composed of persons from support and teaching 
staff to work closely with youngsters at site level. 

3* to bring together resources in personnel and materials In order 
to review a^i consolidate these into a relevant skills sequencing 
for practical application 

4. to establish a schedule of release time t funded by Title VI-G, 
in order to allow freedom for collaboration between team members 
and for observation and demonstration activities. 
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5* to seam 8 © eoMltosnt for an ongoing teaa approach during 1974-1975 
from workshop participants* 

6# to monitor the effectiveness of this inservice design in inoreaaing 
cooperation between support and teaching staff* 



EVALUATION! Special Education/Pupil Personnel/General Education staff will 
nonitor luring 1974-1975 the degree of continuing teas cooperation at school 
site level. Title 71-0 staff will prepare a written report for distribution 
to the Superintendent* Board of Education Ooffittissioners, the Office of District 
Inservice Education, the Office of Special Education and to participants in 
The SMORGASBORD SERIES s PHASE 111, This monitoring effort will reveal whether 
the following stated OUTCOME has been achieved! namely, TO HIBrO ABOUT GREATER 
COLLABORATION BETWEEN SPECIAL AND GENERAL IDUCATION STAFF WORKING WITH SFUSD 
CHILDREN AS TEAMS IN ORDER TO IWROVE EDUCATIONAL PROGRAMS* 



PLANNING COMMITTEE! PHASE III 



Jane Anderson 
Mary BjrA 
Jane Criner 
Joe Dombek 
Marcla Dunn 
Any Eggers 
Elaine Wolfe 
Fern Kelly 

Mary bath King 
Bob Farina 
Edith Paschal 
Juanita Smith 
Betty Thomas 
David Jamie son 



Project Head, Title VI, SFUSD 

Zone I Administrator, SFUSD 

Bay Area Learning Center 

BALC Consultant 

Speech Clinician, SFUSD 

Resource Teacher, Title VI, SFUSD 

Supervisor, Pupil Personnel Services 

Supervisor, District Inservice 
Education, SFUSD 

BALC Consultant 

District Secondary Counselor 

Elementary Prlttary Counselor, SFUSD 

District Elementary Counselor 

Resource Teacher, Title VI P SFUSD 

Supervisor, Psychological Services 



ERIC 
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Name:. 

ERIC 



San Francisco Unified School Distriot 

Special Education Division m Model Project 

Title Vt-G 

mB mAT ' S HAPPEN ING IN LEARNTWfl DISAKjXITOEH 

9.*00 - 10:00 Sheraton Palace Hotel 

M * V*"* 1 ** Keaa *«"» State Department, Speoial Education 
msmm of California Title VI Learning Disabilities Projects 
small group meetings (sessions available IOiJO - 12i00 and liio %*m » „ * 
You may partioipata in two small group meetings, 30 " 3,00 P ' M,) 

Pleases indieata your choice No. A. M. No, p, M . 

1. Evaluation Deaignst Margaret Sah^i^ 

California State Department of Education 
Parlor 0 Sacramento, California 

Dave Uslan 

D « eCt ?f f^ 8 * 60 ** 10 Development) 
for Educationally Handicapped - ' 

Sacramento, California 
2, The Resource Room, Joyee KohfBldt 

Consultant for Leadership Training Institute 
Pai . lor D San Pranoisoo, California 

Lee Wiederhnl+, 

Leadership Training Institute 
Department of Speoial Eduoation 
College of Education, University of Arizona 
■Tucson, Arizona 

3. Language Development! Phyllis Hewonmar , 

Leadership Training Institute in Learning 
Parlor E „ Disabilities arning 

Department of Special Education 
College of Eduoation, University of Arizona 
Tucson, Arizona 

4. Current Trends in Diagnosis! Donald D, ga^dll 

Researcher 

- , Austin, Texas 

Golden Oate 

Harry Ovorl i n P 
Associate Professor 
California State University 
Hayvard, California 

5. Administration and Teachers t Jeanne McCarthy 

49er Room -am ^aderehlp Training Institute 

nyer Room - A.M. Department of Special Education 

California Room - p.m. £ olle « e of Education, University of Arizona 

Tucson, Arizona 

253 
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Appendix 

' ■' PAi^ 

Parental Involvement 

TSiere were 252 parents involved during the school year through 
inserviee workshops f observation of classroom demonstrations, 
and actual participation in actninistering examinations* 

Community Involvement 

Several conminity^wide workshops were held, but attendance was 
not kept* One specific eonminity organization (Health Depart- 
^ and 32 medical staff attended* 

Advisory Council 

The original project ( 1971-72 t 1972-73) proposed three levels 
of Advisory Councils (state*wieie f local district, and technical)* 
The third year project did not propose the continuance of the 
Advisory Councils since the third year was to evaluate the 
, effectiveness of the five proposed objectives* 

However 1 the local Advisory Council representing essentially 
the elementary and secondary instruction division and Pupil 
Personnel division provided coordination with regular education 
and support services and assisted in planning join in-service 
programs* 

The attached itemization presents in sunraary form the parent and consnunity 
involvement. 
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PARENTAL INVOLVEMENT AND COMMUNITY" INVOLVE^T 



---—Role— — « — — 

1 9 Learners 1 . 

2, Audience 2, 

Partic ipators 3 # 

4. Participants 4, 

5* Audience 5* 

6, Audience 6# 

7. Audience 7* 

8, Participants 8* 

9. Learners 9* 

10 * Learners-Audience 10 , 

11, Learners-Audience 11, 



266 



^ ^ :-r Activity 

Presentation to Lawton P.T.A of 
Title VI-0 Model Delivery System, 

Title VI-G services to Lawton* School. 

On-site series of demonstrations, 
workshops, lectures in individuali- 
sing instruction to pupils with 
'" learning disabilities , 

Workshop for Sunshine School P.T.A on 
individualized educational gajnes and 
self -concept inventory. 

Presentation to community members on 
services and functions of Title VI-G 
Model Delivery System, 

Parents observing faculty demonstra- 
tion of a science lesson presented by 
a consultant to the Title VI-G project 
at Second Community School, Noriega 
Home School, Potrero Hill. 

Parents observing on-site demonstra- 
tion of individualizing instruction 
for primary children, by a consultant 
to the Title VI-G project, 

Parents participated with Title VI 
staff, Noriega Home School staff, 
P, A, Hearst School staff in adminis- 
tering Santa Clara Inventory of 
Developmental Tasks. Kindergarten 
pupils, 

Community members attended Leadership 
Training Institute Workshop , "What 1 s 
Happening in Learning Disabilities, " 
Sheraton* Palace Hotel. 

Workshop at Title VT-G Resource Center 
presented by a consultant to project, 
"Motivating the Uninvolved Learner* 11 

Community members attended "Multi-media 
Happening 11 at Potrero Hill given by a 
consultant to Title VI-G project. 



1 OQ 



paremtal wvQummjT and community tmaprnwr 



Continued 
Page 2 



Role ' - .. 

12. Audience 12* 



IJ. Learners 15* 

14, Discussion Group 14, 

15* Discussion Group 15* 

l6, Presenter 16, 



Members of the ooraaunity attended work- 
shop at San Francisco Medical Society 
office. Title VI-G staff member 
presented Self-concept Inventory. > 
Title VI-G staff members were involved 
in all day Health Education Workshop, 

Title VI-G staff worked with parents 
from replication district on educational 
games, 

On-site gone council meeting at Lawton 
School* Discussion of behavior modifi- 
cation techniques. 

Part comiunication groups at Lawton 
and Mark Twain Schools* 

Through observation, worked out an 
improved method of pupil-child 
COTttunication, Lawton School, 
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CALIFORNIA TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SMVICI CESTEK 



SAN FRANCISCO UNIFIED SCHOOL DISTRICT 

PDItt EVALUATION REPORT 

Submitted by 

Theodore 0, Alper, Ph.D. 
and 

Thomas E, Whalen, Ph.D. 

Department of Educational Psychology 

California State University, Hayward 
July, 1974 

with the assistance of 



Susan Ewy, M*S* 
and 

Paul Oareis, B,A, 
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P. - FINAL EVALUATION REPORT 

fc. APPENDIX H 

$mP-:: [ i^y ■■■■ —— 

:p„Abs;tract , .„,.,„.. ', ... . .. 

Introduction 
. Evaluation Design 

Sample 

Data Analysis and Interpretation 4 

OBJECTIVE ONE - Enhancement of Behavior and/or Academic Skills for 
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ABSTRACT 

ra «..«JIhe-. report contained herein describes the. evaluation .design,. 
instruments, arid results for the Title VI-G project for the 1973-197^ 
academic year . An introductory section presents the calendar of events 
for the evaluation activities that were followed in this project* The 
next section includes a description of the target population and the 
design of the evaluation program, 

♦ The major body of the report is organized to follow the 
Title VI-G project objectives* Each of the major objectives and sub- 
objectives is presented, Descriptions of instruments, the times of 
their administration, the results, the discussion of results, and 
summary sections are also grouped according to tne objectives they 
were intended to assess* A section of Appendices follows that provides 
a more in depth discussion of each of the instruments, their possible 
uses, and a sample of each of the evaluation instruments* 

The results of the problem behavior assessments indicated 
that the largest changes observed were for primary level students 
(Grades 1*5)* At higher levels the number of changes observed were 
significantly reduced in the problem behavior area, 

The self-concept results indicated that few significant 
changes were obtained at any level* However, the children involved in 
the sample already had generally positive attitudes towards learning 
prior to the inception of the study . When a comparison was made 
between the teacher 1 s assessment of a student's self-concept and the 
student's own rating of that variable a low relationship was found for 
these two measures* This indicates that future evaluations should 
continue to assess the pupil's own feelings in order to obtain accurate 
information . 264 
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The grade level measures of academic change showed significant 
increases for 7 of 9 variables assessed. Specific criterion references 
measures of reading increased. for 1$ of the 2? areas assessed, while in 
math significant increases were only noted for 8 of 60 possible areas. 
The largest changes were observed for the intermediate group (Grades 4-6) 
on the academic measures, Very few, if any, students were found to have 

achieved • competency in any of the basic skill areas when their scores 

i 

were compared with previously determined standards of proficiency, There- 
fore in almost all oases the pupils involved in this study need further 
remediation. 

The competency ratings of the Special Teaehera indicated they 
were at a moderate to a high level of skill in both instruction and 
assessment areas, The results of all of the Special Teacher assessments 
indicated a careful needs assessment need to be initiated prior to the 
inception of any in-service training program. r Very little correspondence 
was noted in the expressed needs of the teachers for future training and 
the areas perceived by the project staff as needing follow-up. 

The competency ratings of the Regular Teachers indicated they 
improved their proficiency in the target skill areas but. did not achieve 
the level necessary for independent utilisation of the skills they were 
trained in. Again, a careful needs assessment of both the needs per- 
ceived by the Regular Teachers and the goals of the project staff is 
indicated by the data, This would lead to a better pinpointing of 
training areas so as to provide skills the regular teachers 1 both want 
and need to know, 

Overall the data indicated that the project was successful in 
making progress towards the goals as stated by the proposal, In no area 
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SUMMARY 

Systematic changes in pupil performance through the treatment 
period were not perceived by teachers in the three school levels. In 
general, teachers perceived pre-treatment student performance con- 
siderably below grade level, and there were discrepancies in the 
higher grades* The significant changes which did occur were not con- 
sistent across grade levels and were not always in a positive direction 
The intermediate level children were somewhat mixed, and secondary 
children, with the exception of handwriting, regressed further in per- 
ceived grade level standing* Pre-post correlations indicated that 
reading, written language, arithmetic, and spelling skills were rated 
consistently by teachers* These coefficients ranged from .48 to ,88 
across all grade levels. 
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Intr oduo tioh r ~-.<..~*~~~*~:~.^ r -^ 

The ©valuators (Alper and Whalen) were first hired in May 1975, 
to consult with the Title VI-G Project Staff in the San Francisco Unified 
School District. .. During a period of about one month we helped the staff 
to finalize its evaluation activities for the second project year and to 
begin planning a full-fledged evaluation design for the third year* 

In September, 1973 > the ©valuators were again retained for the 
purpose of further refinement of the evaluation design and the develop* 
ment of specific measurement instruments for collecting data. Each 
evaluator spent 10 consultation days during the fall quarter in these 
activities* 

In December, 1973» we. were asked by the Office of Program 
Evaluation, California State Department of Education, to submit a 
proposal for the entire evaluation of the Title VI-G Project, This 
proposal was accepted with further modification in February, 197^f at 
which time we employed Susan Ewy as onsite evaluation coordinator and 
Paul Gareis as a data processing assistant. 

During the month of February all pretest instruments were 
finalized and pre-intervention data were collected during the first two 
weeks of March. Development of all post-test instruments was also 
begun in February and was completed by April 15 f 197^* This phase of 
evaluation activity resulted in an instrument package which consisted 
of 20 separate forms, some of which were unique to the project and 
others which were modified from existing standardized or informal 
inventories* 
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After the instructional intervention period, which began dur- 
ing the middle of March and finished during the last week of May, we 
collected, with the assistance of the project staff, all post-interven- 
tion data. The data were then quantified, processed, and analyzed 
during the months of June and July, 1974, 

The eva] viators would like to acknowledge the cooperation and 
assistance provided by the Title VT-G Project Staff, This evaluation 
effort could not have been brought to fruition without the extensive 
efforts of all concerned. We hope that these efforts can be built on 
by other educators concerned with the education of the exceptional 
child. 
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Evaluation Design 

The model used was, for the most part, a one-group pre-teat- 
post test design. In some instances only post-test data were collected 
and analysed due to the fact that project interventions had commenced 
prior to the evaluators 1 official appointment as evaluation supervisors. 

During our initial work with the project, we suggested the 
possibility of using one or more control groups in the evaluation de- 
sign. However, due to a number of constraints, this was not possible. 

Sample 

The children served by the project were located in 14 schools - 
11 in San Francisco, 2 in Oakland, and 1 in Marin County, Academic, 
behavioral, and affective data were collected from 107 ehildren in these 
schools* They ranged in grade level from the second through the tenth 
grade. There were 33 children at the primary level, 26 at the upper 
elementary level, and 31 at the secondary grade level. The children 
were largely males and a significant number were from minority ethnic 
groups, About three^fourths of the students were males; there were 
64 Blacks, 3^ Caucasions, 5 Spanish, and 4 Asians. 

Data were also collected from a large number of teachers and 
administratora in the San Francisco, schools, Fifty-seven regular and 
special teachers, and 12 administrators and support staff responded 
to various instruments designed to measure their competency levels and 
reactions to the project, 
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Data Analysis and Interpretation 

3t\^ gfl t data We fe grouped into three grade levels , 1-3, 4-6 f 
anq ^12, 4^ data eoiieeted on a pre-post basis were analyzed through 
th% xxse of ^' ^^relate^ t~ m odel , which tests for the significance of 
me^ n differ%^ 0 g betw© en measurements while correcting for possible 
correlation ^ gtW een me an s* 

F 0 ^-\^&3t^onXy data were analyzed through the use of frequency 
c°Unts» mear^ percentages » and comparisons with established referents, 
Ift most caa^ ft ^nalys^g y/e r e made of all instrument items, rather than 
j u at on tota^ g^ores* use of asterisks in Tables denotes t-values , 

o? c^rrelati^^ ^oeffio^ eT its significant at or beyond the ,05 level, The 
n^b@ring of ^^les ia consistent with the number of project objectives 
an^ the asst^^nt of ^xph&bet characters to instruments. For instance, 
Whl# Al.lb j^gyides au^^ry data collected with the Form A for Objective 
1*1 and on i^ ter tnediat e le^ei children {grades (4-6) . 

Dat^ C 0liecti On instruments are found in the appendices. Each 
preceded ^ a brief description of the instrument with suggestions 
fOfr aPpropri^ w use, and information concerning the psychometric 

properties Of instt^gnt, if known. 



OBJECTIVE ONE 

Enhancement of Behavior and/or Academic Skills for Pupils with Learning 
Disabilities and/or Behavioral Disabilities, 

1*1 What are the changes in the number, intensity, and 

frequency of purposeful and non-purposeful behavior 
in the classroom? 

Pour instruments were designed for the purpose of measuring 
this objective! Student or Class Referral Form (A) , Pupil Observation 
Form (High Frequency Behavior - B), Pupil Observation Form (Low Fre- 
quency Behavior - C) and Contract Counts (D) . 

Of the four instruments , only one was fully developed in time 
for pre-and post-measurement. This was the referral form, Thus, the 
data from this instrument will provide the bulk of evidence with which 
to evaluate objective I.a* Some information was collected, also, on 
the use of behavioral or academic contracts between teachers and 
children* These contract results will be presented following the 
results of the Behavioral referral data. 

Problem Behavior 

The first section of the referral form contains 16 items 
measuring problem behavior* Examples are out of seat, yelling out* 
and running around the room* For each pupil referred to the project, 
a teacher was asked to fill out the referral form by rating each 
problem behavior on a 4-point scale as high, medium, low, or never 
occurring* At the end of the intervention period, the teacher again 
rated the child 1 s behavior* Score distributions were then analysed 
by comparing pre- and post-intervention levels by use of a t-test 
for correlated measures. 



The same procedure was used for the second part of the form 
which dealt with work-related student behavior. This section was 
represented by such items asi attends class, stays on task, works 
independently, follows directions, etc, Since these items represent 
positive .behavior, the scale values were reversed so that on both 
sections of this instrument, a score of h means the most positive 
level of behavior, and a score of 1 indicates the most extreme of 
negative behavior, 

Results 

Primary Level, Grades 1-3 

Of the 16 problem behaviors on the referral form, the most 
frequent problem according to teacheri 1 ratings was out of seat be- 
havior, The mean rating on this item for all primary children was 
2,03, indicating a medium frequency of out of seat behavior for most 
children. The behavior which showed least frequent occurrence was 
item 11, destroys others 1 property. The mean for this item on the 
pre-intervention ratings was 3,44, indicating a group average about 
midway between low occurrence and never occurring on the 4-point scale. 
Most of the items were rated on the average between medium and low 
occurrence. Only 4 of the items were rated between low and no 
occurrence. These were 9, 10, 11, and 15, which referred to stealing, 
destroying property, and lying. 

The post intervention results (Table Al.la) show remarkable 
improvement in reducing pupils' problem behaviors, A total of 13 
behaviors showed improvement, and seven of these were statistically 
significant at the .05 level, These behavior were (l) out of seat, 
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(2) yelling out, (5) running around room, (k) hitting and pushing, 
(7) complains, (8) fighting, and (16) temper tantrums* One of these, 
out of seat behavior, showed improvement beyond the iOOl level of 
significance. 

On Part II of the referral form dealing with work-related 
student behavior, there were also several significant improvements in 
behavior for primary children. Items 6 and 7 showed improvement beyond 
the ,05 level of significance. These items dealt with the child's being 
able to work independently and working as a member of a group* Items 9* 
11, and 12, attempting difficult work, taking pride in work, and organ- 
izing materials and work, were all significantly improved beyond the 
.001 level of significance. All other items in Part II showed the same 
degree of improvement with the exception of item 1, attends class, which 
was rated slightly lower on post-measurement. 
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Table Al.la 



Changes in Problem Behavior and Work-Related Clasaroora 
Behavior Among Primary Level Children 
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Intermediate Level, Grades 4*-6 

.Among upper elementary pupils, problem behaviors were not viewed 
as seriously by the teachers. Seven of the 16 behaviors received mean 
ratings above 5.00 at time of referral indicating low occurrence fre- 
quencies for fighting, stealing, destruction of property, talking back 
to teacher, lying, and temper tantrums, 

The post* intervention data (Table Al.lb) shows significant change 
on only one problem behavior, item 15, excludes self from activity out- 
side class. This behavior was significantly reduced at the ,01 level, 
indicating that by the end of the year students were participating in 
outside class activities at higher levels than before, 

Among the work related behaviors, Part II, teachers viewed items 
9 and 12 as the most serious problems * These dealt with attempting 
difficult work and organizing material s and work* Class attendance was 
rated highest of all items, a mean of 3.4l f indicating that teachers 
perceived this as less of a problem than anything else, All other 
items had mean ratings of between 2,00 and 3,00 at referral time, 
indicating low to medium occurrence frequencies for the work-related 
behaviors. The post*intervention results show eleven improvements 
in student behavior. However, none of these were significant statis- 
tically. 



Table AUb) 

Changag in Problem Bshavier and Work Related Classroom 
Behavior Among Intermediate Level Children 



o 







its 




Tin — X m 

Post-T 


eat 


Item | 


Mean 


3D 


Mean 


IS 


1 


(14) 25 


2,32 


1*10 


^ ll A 

2,40 


1 if 

1.15 


2 


(1-2) 26 




1 ^A 

1.33 


2,5? 


1,10 


3 


(1-3) 25 




.8) 


2,84 


1,02 


4 


(14) 26 




qp. 


2,69 


I.Qq 


5; 


(1-5) 26 


2«07 


.97 


2,23 


1,06 


!: 6" 


(1-6) 25 


2*1/ 


1,02 


2,3^ 


.93 

1,15 


7 


(1-7) 25 




1,02 


2,60 


8 


(1-8 26 




,9? 


3,00 
3.73 


.69 


9 


(1-9) 26 


? Da 

3,oQ 


,40 


•53 


10 


(MO) 26 


3»6 


.6) 


3.50 

3,04 


.90 


11 


(Ml) 25 


3.68 


.55 


.63 


12 


(M2) 26 






3.46 
3,24 


.76 


13 


(H3) 25 


3. HO 


•71 


■7? 


\k 


(H^) 26 


2.O3 


1.0) 


2,30 
2.92 


1.19 
1,11 


15 


(145) 25 


ft in 

2,32 


.94 


16 


(1-16) 26 


3.50 


.98 


3,42 


,70 


1? 


(IM) 2k 


^ 111 

3,41 
2,19 




3.37 


-92 


18 


{114) 26 


D)i 


2,07 

2,30 


,89 

Aft 

.92 


19 


(n-3) 26 


A a£ 




20 


(114),. -26 


a ai 


.70 


2,26 


,8? 


21 


(n-5) 25 : 


n Aft 

2*00 


JO 


2,12 


.78 


22 


(II-6] '26 




fll 

•01 


A 7 1 


.89 


23 


(n-7) 25 


a AS 


•79 


2,2o 


.73 


24 


lII-B) 2) 


a a9 

2i0o 


1 All 


2,04 


,87 


25 


(11-9} 26 




*o2 


Los 


.71 


26 


(IMO) 26 






2<5f 


•90 


2? 


(11-11) 26 


2,50 


.76 


2.61 


.75 


28 


(11-12) 26 


I.96 


.91 


2.30 


.83 
.95 


29 


(11-13) 25 


2^ 


,61 


2,60 


30 


(11-14) 26 


2*0? 


,8H 


2,23 
2,96 


.99 


31 


(11-15) 26 


2,80 


,80 


.77 


32 


(11-16) 26 


2-53 


,81 


2,57 


.90 



Mean 
Difference 

-0,08 

,11 

.00 

,00 
-0.15 
-0,17 

.08 

.07 
.07 
,11 

.04 
-0,03 

,24 
-0.26 

-o,6o 

•07 

' .04 

,11* 
-0,03 
-0,03 
-0,12 
•0,11 

,00 

.01 

•0,23 

,00 
-0,11 

-0.34 

-0.20 
-0,15 
-0,15 
-0,03 



Correlation t-ratio 



•?? 
.59 

.52 
.63 
.73 
.51 
•35 

.41 

.24 



67 

•35 
.50 
-57 
.56 
.62 

.49 

.*) 
.59 
M 
,70 
.62 
.32 
.67 
.64 

■31 

.5* 



.52 

.53 
.00 
.00 

.89 

1.16 
■37 

,81 
.68 

,27 
.25 
2,00 

1.19 

3.13 
M 

,20 

.68 

.25 

■25 

.90 

.68 

,00 

.23 
1.65 

,00 
.90 
1.73 
U 
1,00 
M 

•23' 



Secondary Level, Grades 7-12 

Among the older children in the project samples, problem be- 
haviors are much less frequent as viewed by teachers * Eight of the 16 
behaviors received mean ratings of 3*00 or above at referral time. This 
indicated that such behaviors as hitting and pushing, fighting, stealing, 
destruction of property, talking back, lying, and temper flare-ups, were 
of generally low frequency* 

In Part II of the referral form, more concern was shown by teachers 
for needed improvement in work-related behaviors, Only one item received 
a mean rating above 5*00, attends class. Thus all other work- related be- 
haviors were viewed as having only low to medium occurrence* 

Table Al.lo gives the results for the pre- and post-intervention 
ratings* Only one item on both parts of the instrument changed signifi- 
cantly over time* This was -item 11, Part I, destroys others 1 property* 
There was a significant reduction in this behavior by the end of the 
year. 
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Table A1.1C 



Change! in Problii Behavior and Work-Relited Classroom 
Behavior Aasng Intermediate Level Children 

Preheat Post-Test Mean 

Jteja N Mean , JB Mean SD Difference Correlation t-ratio 

' 1 (14) 11 2,36 1,12 2,6) ,92 -0,27 1,62 1,00 

. 2 (1-2) 11 2.5^ 1.0) 3.00 ; 1.00 =0.45 ,57 ' 1.61 

3 (1-3) 11 2.63 1.20 3,00 .89 .0,36 ,83 1.78 

* (I**) U 3.^5 .52 3.27 .64 .18 ,78 1,49 

5 (1-5). U 2,72 .90 2.45 ,52 ,2? ,71 1,39 

6 (1-6) 10 2,80 .78 2,90 ,31 -0.10 ,35 M 

I (I'D n 2.54 ,93 2j .92 .18 ,32 ,55 

8 (1-8) 11 3,5* ,52 .52 .00 1,00 .00 

9 (1-9) 10 3.30 1.05 33 .70 -0,20 ,81 i.oo 

10 (wo) 11 3,63 ,50 3.36 ,67 .27 M I.39 

II (141) 11 3.09 S 3.^5 .52 -O.36 .92 2,39 # 
12 (1-12) U 3.00 1,00 2.90 ^ ,09 ,7* ' 43 

- 13 (H3) 9 3.H .60 3.22 M -0,11 ,36 3 

14 (HI) 11 2,27 I.3H 2.6 1.29 -0,18 .95 1,49 ' 

15 (145) 8 2.25 1.16 2.50 1.06 -C.25 .80 1.00 

16 (146) 11 3,72 M 3.90 ,30 -0.18 .37 1,00 

17 (JI4) 11 3.18 ,87 3.27 M .0,09 ,78 .55 

18 (II-2) 11 2.72 ,78 2.45 .52 .27 ,57 1.39 

19 (HO) 11 2.63 1,02 2,81 ,60 .0.18' .36 61 

20 W 11 2,81 ,75 2.81 ,87 ,00 .70 .00 

21 (11*5) 11 2,90 ,70 2.90 1,04 .00 .53 ,00 

a »K) 11 2,81 ,75 2,72 ,90 ,09 ,36 .31 

23 (IH) 11 2.63 1.12 2,54 ,93 ,09 .87 ,55 

24 (11*8) 2 2,50 2.12 2,50 2.12 .00 1.00 2,00 

25 (IH) 11 2,81 ,87 2,^5 .82 .36 .511 1 49 

26 (11-10) 11 2.72 .78 2.72 .78 .00 .58 . !oo 

27 (n-11) 11 2.90 1,13 2.90 .70 .00 .61 .00 ■ 

28 (1142) 11 2.27 ,90 2.45 ,82 ,0,18 ,19 ,69 

29 (11-15) 11 3.OO ,63 3.00 M ,00 .35 .00 
no I 30 (1144) 11 2,36 1,02 2,63 1.12 *0.2? .82 1,39 283 



31 (1145) 11 2,90 ,83 2,90 .83 ,00 .56 

32 (1146) 11 3.00 1.09 2,72 .90 ,27 



.00 
1.39 



It is evident from Tables Al.la, Al.lbj and Al,le that the project 
had its greatest apparent impact on primary level children * At that 
level there were maty significant improvements in both problem behavior 
and worker elated classroom behavior* However, at succeeding higher age 
levels* the number of significant changes in behavior drops dramatically * 

It is interesting to note that the pre-post item correlations at 
all age levels are very high on the average* An average of 26 of 32 
items at each level show pre»post correlations significant at the ,05 
level or beyond. This would seem to, indicate that teachers are quite 
consistent in their rating behavior over time f and that the instrument 
is reliable enough to produce accurate measures of student classroom 
behavior. 
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Contract Count (D) 

The contracts employed by the project staff during the interven- 
tion period were analyzed by the evaluation staff following the ending 
of the school year. Form D (see appendix for description) was utilized 
to record the type of contract (verbal or written), duration of contract, 
academic area of contract or behavioral area of contract, schedule of 



rewards f type of reward, and the success or failure of the student to 
meet the contract. This form allowed the evaluation staff to analyze the 
contract results without interpreting the original documents themselves, 

The sample of contracts analyzed was 18 overall. This indicates 
that either very few contracts were utilized by the project staff or 
that the project staff was not consistent in their record keeping on 
Form B, The following list describes the major outcomes of the contract 
count analysis, 

1 * Demographics of Contracts Sample— ? 

a. l4 of the contracts were written for males and 4 
for females, 

b. 4 were from the primary level, 4 from the inter- 
mediate, 6 from the junior high level, and 4 
from the senior high level, 

2, Contract .Formal" &1% of the contracts were written; 
all the rest were verbal in format, 

J, Contract Content^ 6?^ of the contracts were written to 
change the inappropriate behaviors of the students, 
33jS of the contracts were designed to increase academic 
performance, 

4, Type of Reward and Schedule" 6?^ of the contracts used 
tangible rewards and all of the rest used a combination 
of privileges and free time, ^0% used a fixed ratio 
schedule, 44J5 used a fixed interval schedule, and 6% 
used a combination (fixed-ratio, fixed- interval } , 
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5, Cent rag t Time Length -** The duration of the contracts was 
from one week to five months, 

6, Contract Success^ 7&% of the contracts were successful 
overall in that the student met the goal and received the 
reward- All of thf non- successful contracts were written 
at the secondary level, They all focused on changing the 
student's inappropriate behaviors and none of them used 
tangible rewards, 

7 , Use of Behavioral Principles in Contracts— 

a. All of the contracts utilized positive reinforcement, 

b, None of the projects suggested that any baseline data 
was gathered prior to the contract being initiated, 

c * None of the contracts suggested the use of shaping 
of the response requirements for reinforcement, 

d. None of the contracts provided evidence that the 

schedule of reinforcement was systematically leaned 
out over time. 

The analysis of the data indicates that when used and reported 
the contracts were successful over 75$ of the time. The major question 
is since there were so few contracts recorded on Form D we may be 
analyzing an unrepresentative sample. The unsuccessful contracts might 
not have been reported by the project staff, The contracts 1 content 
indicates that they were used as behavioral control devices in a major- 
ity of the oases, Therefore contracts were not systematically applied 
as part of regular academic task assignments, This is further backed 
up by the duration of the contracts which was one week or more in all 
cases. Rather than utilising small rewards continuously for improvement 
they seem to have been employed for only gross changes. All of the 
comments in point 7 also lead on to make the conclusion that the project 
staff either did not know the underlying behavioral principles of con- 
tracting! or were forced to violate them by the pressures of the real 
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classroom. The eontraGta as reported in this seation are poorly 
designed and would lead to only momentary control rather than long 
lasting behavior changes* They all seem to violate the idea of 
starting where the child is and movirig along with him by reinforcing 
improvement * 
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1*2 What are the changes in pupil self-concept? 

This objective was evaluated through the use of two instruments, 
the Inferred Pupil Self-concept by Teacher (Form E) and the Pupil 
, Self-concept Inventory (Form F) . Originally, both of these instruments 
were intended for use on a pre-post basis, However, Form E, the teacher 
rating instrument, was not completed before some of the pretesting with 
Form F had already taken place. Thus, a decision was made to utilize 
the Pupil Self-concept Inventory (P) as the primary measure of change 
for objective 1.2. The Inferred Pupil Self-concept by Teacher (Form E) 
was utilized on a post-test only basis for the purpose of determining 
to what extent pupils and teachers agreed with one another on a specific 
subset of items dealing with the pupils 1 attitudes toward school 
activities* In this section, the results of the pupil self-report 
ratings are presented first followed by the teacher ratings of pupils 1 
attitudes * 

Pupil Self-concept Inventory (F) 
This instrument, shown in the appendix, contains 33 items classi- 
fied in 5 separate categories i (1) About Me, (2) About School and 
Learning, (3) Me and My Teachers, (4) Other Grownups and Me, and (5) 
Me and My Family, This instrument can be administered in paper and 
pencil fashion* or it can be used in the form of a game. The game 
utilizes a board similar to monopoly, a deck of cards for each player, 
a pair of dice, and four cups decorated with smiling and frowning faces. 
The child roles a die and moves a piece around the board. He draws 
cards from his deck and reads, or the administrator reads to him, the 
statements on each card. The statements correspond to the items on 
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the printed form of the instrument* After reading the card, the child 
places it in one of the four cups corresponding to the ^point measur- 
ing scale of affect* In the present study, most children were adminis- 
tered the instrument in game form and played with one or two other 
children, The only restriction placed on this type of administration 
was that a child had to play the game with the same number of children 
-on both the pre-aession and post-session, though the individuals did 
not have to be the same* The reason for this was to attempt to control 
for any 'Socialization" effect which might be present, A further re- 
search study should be done to determine if children respond differently 
with different numbers of children playing the game, or whether they 
respond differently by taking the inventory alone as a paper and pencil 
exercise. 

Results 

Primary Level, Grades l-J: 

Table Pl*2a gives the results for the primary level children. 
There were 26 children in this group, although some children did not 
respond to all items on the inventory either on the pre- or post- 
administration. This is reflected in Table PI, 2a by somewhat fluc- 
tuating N f s across the 53 items, 

In the About Me category, pupils felt rather good about their 
appearance (item A-l), somewhat unhappy about being alone (item A-2), 
and when unsure about what people wanted them to do (item A-3) , They 
felt very unhappy if someone hollers at them (item A-4) . All of these 
feelings were elicited during the pre-intervention phase and did not 
change markedly after intervention. 
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In the About School and Learning category, there were 15 Items 
concerning many different phases of school activities* Surprisingly, 
pupils indicated some measure of happiness on 12 of these items on 
the pre-test* Only on items B-2, B-12, and B-13, reading aloud, being 
late for class, and being asked to stay after school , were they some- 
what unhappy (as a group), Only one item in this category showed a 
significant group change at the end of the intervention period. This 
was item B*6s going to art time, Even though students had a high 
initial liking for this activity at time of pre-testing, their pleasure 
in art work increased even more after intervention* 

In the category, Me and My .Teachers. , most pupils indicated some 
degree .of pleasure about their relationships with their teacher . The 
one exception to this was item C-5* if teacher visited my home, which 
caused them mild displeasure. On the other hand, pupils as a group, 
were -extremely pleased to have their teacher come to their desks, 
After intervention, there were minimal changes on these items, none 
reaching a significant level, 

The fourth category f Other Grownups and Me , ahqwed one signl- 
fioent change over time. This was item seeing your counselor. 

Children changed from mild to considerable pleasure in seeing their 
"counselor" after intervention* Since primary level children do not 
have counselors, it can only be assumed that they associated this 
title with the Title VI-G staff person who worked with them, 

There was also one significant change in the fifth item category. 
Me and My Family , Item E-4 f ' playing with your brothers and sisters, 
showed a significant change in a positive direction. Before inter- 
vention, children were mildly happy about playing with their siblings, 
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This changed to much more pronounced happiness after intervention * 
Interestingly f all other items in this category also showed positive! 
though not significant, changes over time. 
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Intermediate Level , Grades k**6t 

The results for the upper grade elementary children are quite 
different from their younger peers. Whereas the primary children showed 
significantly positive changes on three items, the older children had 
four significant changes in a negative direction, and only 6 changes in i 
positive direction on the entire instrument. On items B-2 f B-3, C-3, 
and E-l, the children as a group felt significantly less happy after in- 
tervention, These items dealt with reading aloud, doing written work, 
doing homework, and having the teacher talk to parents, It would appear 
that these children were feeling the pressure of the intensive project 
intervention at post-test time to a much greater extent than the younger 
children. This situation is somewhat in accord with observations by the 
©valuators, that intermediate level schools received more intensive help 
from the project staff than other levels (see objective 4 following}. 
Another thing which must be considered in the interpretation of 
these data is that in general, intermediate children responded at higher 
affective levels on the pre-test than did primary children, Thus, to 
some extent, at least| there is a ceiling effect operating with some of 
the items* On fully 26 out of 33 items the intermediate children scored 
higher than primary children on the pre-test, 

A similar phenomenon was present with respect to a comparison betweei 
the intermediate children and a group of comparably aged children in a 
Marin County replication school. In this comparison, the San Francisco 
children scored higher on 2h of the 33 pretest items. It is difficult, 
without further research to adequately explain these differences. But 
it seems that the Pupil Self-concept Inventory does discriminate between. 



293 

22 



children of differing backgrounds to some degree. This situation is 
brought out further in the results for the secondary pupils which 
follow. 



ERIC 



291 



23 



Tibia Fl,2b 
Changes in Pupil Self-Concept for 



Intermediate 



Level 



Pre-Test ■ Post-Teat 
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Secondary Level, Grades 7-12 s 

Among the junior and senior high school students there were only 
two significant changes from pre* to post- intervention scores* These 
ware items A-2 and A-3* being alone * and not being sure what people 
want you to do, The first of these items showed a more positive post- 
intervention attitude toward being alone. The second change was in the 
other direction* At the end of the year, students felt significantly 
less happy when they were not sure what other people wanted them to do. 

Other changes for the secondary students were generally mixed 
between positive and negative directions and were of a magnitude which 
did not reach statistical significance at the *05 level* A cheek of 
the results between the three different levels of students showed that 
considerable differences existed between group means on the pre- and 
post- tests for a large number of items* Although an analysis of 
variance was not performed, it appears that items B-l, B-5* C-2, C-J, 
C-4, C-5? D*2, E-l, and E-2, would probably generate significant 
P values indicating a strong difference in absolute affective levels 
between the three age levels of children* 
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Changes in Pupil Self-eoncipt for Secondary Level 
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2,91 .99 


-0,08 


.56 


,26 




12 


2,08 


,99 


2.ll ,79 


-Q 33 


.52 


1,30 


10 (B-6) 


12 


3,66 




3.58 .66 


08 




11 B-7 


12 


3,16 


1,02 


3.16 ,93 


.00 


72 


00 

iwu 


12 (B-8) 


12 


2,01 


l.lfi 


1 16 01 




50 






12 


2 33 


1 W 




-.fl 1^ 


.38 


,50 

00 

1 Vv 


I 1 ! (HO) 


12 


2.91 


1,16 


2.91 .99 


.00 


15 (Ml) 


12 


2,91 


.90 


2.83 .93 


,08 ' 


>73 




16 (B42) 


12 


2,66 


1.07 


2.50 1 l6 


16 




M 


17 (B-1J) 


12 


u 


,66 


1,11 .90 


.00 


-0,16 


,00 


48 (B-14) 


12 ! 

*** 


3,25 


i.05 


3 75 W 








19 (B-15) 

20 (C-1) 


12 
12 


3,00 

2.75 


,86 


3.oo ,95 
2.50 .79 


.00 

.15 


,22 

.36 


,00 

.61 


21 (C-2) 

22 C-3 


12 
12 


2,66 
1,66 


.77 

1.07 ■ 


2,83 83 
1-58 66 


-0 16 

,08 


16 


2l 


23 (C4) 
21 (C-5 

25 c-6) 


12 
12 
11 


1.66 
1,66. 
3.18 


1,07 

.88 
.98 


1.66 1.07 
2,08 ,90 

V ! W 1 jfW 

3,18 .87 


1 vv 

-0,11 

v i ! m 

.00 


21 


1 M 

ill? 

fin 


26 JW 


12 


2,25 


.86' 


2,58 .66 

^ 1 jy 1 ww 


.lO 




i. TO 


2? D-2 


12 


3.33 


.98 


3.16 ,93 


.72 


BO 


28 (D-3 . 


. ,12 


2,91 


1,08 


2.66 ,77 


,25 




89 


29 (1-1) , 


12 


2.25 


,86 


2,50 .90 


*0,25 


.63 


l.ll 


30 (1-2) 


12 


1.66 


.88 


1,91 1.08 


■ -0.25 ; 


' ' .25 


-71 


31 (E-3) 


12 


5.58 


.66 


3.58 .90 


,00 


.89 


,00 


32 (rtj 


11 




,68 


3.te 1.03 


,00 


,66 


.00 


53 (15-5) 


11 


3.^5 


1,03 


1,0) 


■0.09 


.95 


1,00 



Summary 

Because of the relative few number of significant changes among the 
three levels of children, and the fact that these changes were by no 
means uniform across levels, it is tempting to say that the instrument 
itself produces erratic and unreliable data. However, two facts mitigate 
against this as the sole conclusion. First, a pilot study was conducted 
with the instrument using non-project fifth grade students in Sfin Francisco 
(see the appendix). This was a test^retest reliability study over a two, 
week time period. Though this study showed that several items on the 
inventory are fairly unstable, in the main, ' it showed that the instrument 
has a fair degree of stability over time, Secondly, an analysis of the 
pre^post item correlations for the project data show a similar findingf 
at least at the higher age levels. Among the secondary students, 19 of 
33 items had pre-post correlations ranging from ,50 to ,96, At the 
primary level, this figure dropped to 2 of 33 items with correlations 
above *S0, There are two possible reasons for this extreme difference 
in stability across levels 1 (1) the younger children, in general, had a 
much longer time between the administration of the pre- and post-tests 
than did the older children, (2) it is likely that self-concept, as a 
psychological construct is much more fixed and less amenable to change 
among older children. 

In conclusion, it cannot be said with any certainty that the 
Title VI-G project had a strong impact on children's attitudes toward 
school and learning, What does seem to be apparent from this study, 
however, is that LD children's attitudes toward education are not 
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drastically low to begin with, The great majority of children in this 
sample appear to have relatively healthy attitudes toward learning 
. already, at least as measured by the instrument employed here. This 
finding tends to be in accord with some other recent studies which in^ 
vestigated differences in affective levels between minorities, disadvan 
taged children, and middle class white pupils. Perhaps the time has 
come to stop worrying so much about students self-esteem and to con^ 
centrate more on raising their basic skill levels, 
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Inferred Pupil Self-Concept 

Rating by Teacher (E) 

As mentioned previously, this instrument was not available for 
use during the pre-* intervention phase of the project. Thus, data ware 
not collected on children at the time of their referral, The results 
presented here are for post- intervention ratings made by teachers of 
their pupils 1 attitudes toward school and themselves* 

Form E requires that the teacher make an assessment of a child 1 s 
attitudes in 7 categories! (1) being in school, (2) being around teachers 
(3) arithmetic, (4) reacting* (5) homework, (6) his or her appearance, and 
(7) overall scholastic ability (his or hers), The first six items are 
rated on a 4 point like-dislike scale, Item 7 was rated on a 4- point 
scale going from "quite confident" (4 points to "lacking confidence" 
(1 point), 

'Hie reason for collecting and analysing the data from Form E was 
largely for research purposes. Since each of the seven items on this 
form was keyed to an equivalent item on Form F f the Pupil Self- concept 
Inventory, it would be possible to determine (1) if teachers 1 ratings 
were in agreement with pupils 1 own ratings, and 5 therefore (2) whether 
future project evaluation efforts could rely solely on indirect self- 
concept data provided by teachers. 

In order to interpret the findings of this study, it is necessary 
to refer to Figure El #2, This figure shows the items from Form E along 
with the matched item from Form F, the Pupil Self-concept Inventory, 
It will be noted that there are substantial differences' in the working 
of some pairs of items between instruments. This was intentional, but, 
of course, created a potential source of error in measurement of specific 
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attitudes* However, one of the intentions of this study was to determine 
the- relative robustness and strength of attitudes and their associated 
behavior patterns. In other words, we were interested in finding out, 
for instance, if a students attitude toward taking a test (B5) was ,, 
related to his teacher's perception of his overall scholastic ability 
(item 7i Form E) § 

Results 

Table El,2 gives the results of item comparisons at the primary, 
intermediate, and secondary levels 8 The coefficients of correlation at 
all levels are extremely low, and quite often even negative. Nona of 
the coefficients indicates statistical correlation at the *Q5 level of 
significance. Thus it can be concluded that teachers* perceptions of 
students 1 attitudes do not correspond to the self-reported attitudes of 
the students, themselves* It is also interesting to note that at each 
level there are one or raei^e item pairs which differ from one another in 
elevation f i*e., the mean rating given by the teachers is significantly 
higher or lower than the pupil mean rating. This is further evidence 
that, in this single study at least , teachers do not appear to be able 
to correctly infer the child's attitudes toward themselves and their 
school environment* Obviously, future program evaluations must continue 
to gather self-concept data directly from students | inferential teacher 
ratings will not suffice* 
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E^.;''.^,.:-.^- Pip's J1.2 

W;. Item Pairs from Forms E and P 

£y;\ . . ..... 





Teacher items (I) 


Pupil Items (P) 


Itl 


i No. 


Item No, 


6, 


His or tor appearance 


Atl When you look in a mirror 


1. 


Being in school 


Bil Cosing to school in the morning 


K 


Riading 


B,2 Reading aloud 


3. 


Arithmetic 


B.l Doing arithmetic 


7. 


Overall scholastic ability 


B.5 Taking a teat 


2, 


Being around teachers 


C,2 Being around my teaehtrs 


?. 


Overall scholastic ability 


Ck Ttfteher shews your work to class 


5. 


Hon work 


E.l Doing horns work 



Notes Item / (Porm E) was paired with two items, B.5 and 0,1 on Fori F, 



Table E1.2 

■ Correlations . of ,Iten-palr8 from the Pupil Self-concept Inventory (F) 
and the Inferred Pupil Self*eoneept Rating, Teaehsr (E) 



Mian 





Item Pairs 


1 


Correlation 


Difference 


t-ratio 




A.l 


0 


2? 


,17 


-0,03 


.15 




B.l 


1 


27 


_ i. 

.14 


,40 


1,65 




B,2 


If 


26 


-0,00 


,88 


3.05 * 


Primary 


B,4 


3 


26 




,00 


.00 


Level 


B.5 


7 


26 


-0,18 


-0,42 


1.18 




C,2 


2 


26 


-0,31 


.53 


1.97 




CI 


7 


26 


-0.18 


-0,50 


l.»3 




E.l 


5 


25 


-0,19 ' 


-O.I6 


M 




A,l 


6 


25 


-0,19 


-0.68 


2.65 * 




B.1 


1 


25 


- A 

.18 


-0.04 


.17 




B,2 


\ 


25 




M 


2,97 * 


Intemeolat 


e B.l 


3 


^ 24 


-0.27 




1.77 


Level 


B.5 


" ? 


25 


-0.13 


-O.56 


1.73 




0.2 


2 


24 


.05 


-0.08 


.31 




A 1, 

C,4 


7 


25 


.15 


-0.56 


1.97 




E.l 


5 


24 


-0.32 


-0,8? 


2,83 * 




Ail 


6 


10 


-0.02 


,00 


,00 




B.1 


l 


12 


,15 


-0,16 


, i - 

M 




B,2 




12 


.28 


- .33 


1,07 


Secondary 


B.H 




12 




-0.75 


2,01 


Level 


B.5 


? 


12 




-0.25 


.76 




C.2 


2 


12 


-0.04 


.00 


,00 




C.» 


? 


12 


,2V 


,50 


1.39 




1.1 


5 


12 


.00 


-0,35 


1,00 



Note { A positive ffiean difference indicate! the teacher ratings were more positive, 
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1,3 What are the changes in pupil academic performance? 

This objective was viewed by the ©valuators and also by the 
project staff to be of relatively greater importance than most other 
Project objectives* For this reason, it was assessed through the use 
of many different instruments ■ and procedures. This section will give 
the results of six separate measures of academic performance (see Forms 
G, H, I, J, K f and L in the appendix)* 

Teacher Rating of Pupil Academic Performance 

In addition to collecting data on actual student achievement, it 
was felt that the teacher's perception of a student's progress was 
also an important dimension of the project's impact on teachers; thus 
a short rating instrument was designed to collect such information, 
This instrument (Form G) was administered on a pre-post basis. It 
contains eight subject areas; (1) reading, (2) oral language, 
(3) written language, (4) arithmetic, (5) spelling, (6) handwriting, 
(7) science, and (8) social studies. Each teacher was asked to assess 
a student's ability in these areas at time of referral to the project 
and again at the end of the intervention period (end of school year). 
The ratings were made on a 4-point scale anchored to grade level 
standing, A student whose perceived performance was "more than 
2 grades below" his current grade level was given a score of 1, A 
score of 2 was assigned a rating "below grade \level," A rating of 
"within grade level" received 3 points, And performance "above grade 
>vel" merited k points on the scale, 
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Results 

Primary Level f Grades 1-3 

Teachers perceived written language performance as the weakest 
of the academic areas measured* Their average rating of 1,56 indicated 
average performance close to two years below grade level for the 16 
children in this sample. Their highest rating was for oral language 
ability, which received an average rating of 2,4? at time of referral, 
This indicated that teachers viewed the children somewhat below grade 
level in this area but not too far below. All other pre- intervention 
ratings were between these two extremes, mostly hovering around 2,00 t 
with the exception of reading which received a 1.6k mean rating, To 
suiraarize, then, most children were rated "below grade level" in 
most areas with the exception of written language and reading which 
approached two levels below, and oral language which was just slightly 
below grade level. 

The post* intervention ratings showed positive changes on 5 items; 
reading, written language, and science 1 negative changes on 2 items 1 
oral language and spelling; and no changes at all on 3 items 1 arithmetic , 
handwriting, and social studies. Only one of these changes was statis* 
tioally significant at the ,05 level, and that was in a negative direc- 
tion* Oral language was rated as significantly poorer on the post- 
intervention scores. It should be noted that this item had the lowest 
pre-post correlation, indicating that it is probably less reliably 
measured than most performance areas. Thus, this significant negative 
change should probably not receive much emphasis, 



Table 01, Ja 

Pre- Post-Intervention Changes in Teachen 1 Perotptions 
of Primary Pupils' Academie Behavior 







Pre-T 


est 


Post-Test 


If JHW 

Mean 






Item 


1 
17 


Mean 


i 


Mean 


3D 


Difference 


Correlation 


t-ratio 


Reading 


1,64 


♦70 


1,76 




-0,11 


.77 


1,00 


Oral 


17 


2.47 


.79 


2,00 


.61 


M 


.38 


2,42 


Writtin 
Language 


16 


1,56 


,62 


1,62 


.71 


-0,06 


.79 


.56 


Arithaietie 


17 


2.11 


,69 


2,11 


.69 


,00 


M 


,00 


Spelling 


17 


1*00 


,oO 


1,82 


,80 






k% 
*v 


Handwriting 


16 


.. 2.06 


,68 


2,06 


.77 


,00 


.75 


,00 


Seiinee 


16 


2.12 


Jl 


2.18 


.65 


-0.06 


.51 


,36 


Social 
Studies 


16 ■ 


2,18 


.75 


• 

2.18 


.65 


,00 


,60 


,00 



Intermediate Level, Grades 4-6 i 



It is interesting to note (Table 01 .Jb) that on all measures 
teachers 1 ratings of intermediate pupils averaged about on-half 
point lower than for primary pupils* This would seem to agree with 
past research which has shown that LD children tend to fall further 
behind their classmates at each succeeding level* These pre-inter- 
vention ratings, which average between 1*26 and l,8o, reflect teacher 
perceptions of pupil performances which is generally close to two or 
more years below grade level* 

The post test data indicated perceived positive changes on 
seven of the eight items* Only spelling changed in a negative direc- 
tion! and then only very slightly s One of the positive changes, 
arithmetic , was significant at the *05 level; and two other changes, 
reading and written language, approached statistical significance* 
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Table 01, Jb 

Ere- Post-Intervention Changss In Teachers 1 Pireiptiona 
of IntiMidiata Pupils' Aeadeiio .Behavior 

Pretest Post-Test Mean 

Item g Mean JD Mian 3D Difterjenge Correlation 

Reading 26 l.JO ' ,5* U6 .50 -0.15 .61 
Oral 

Language 25 l.BO ,8l 2,00 ,86 -0.30 , .23 
Written 

Lmpaga 26 1.26 ,k$ ij M -0,11 ,?6 

i 

Arithmetic , 1.46 .58 1.76 .71 -0.3Q .55 

spelling 25 1.36 ,56 1,32 M .0* .63 

Handwriting 26 1.53 $ I.69 .73 -0.15 .27 

Science 2% 1,66 ,70 1,75 .73 -0.08 ,i2 
Social 

Studies 21 1,53 .65 1.70 ,75 -0.12 ,36 



Secondary Level, Grades 7-12 

The pFe-intervention ratings for secondary pupils (Table Gi,3o) 
show further reductions in relative performance for math, handwriting , 
science, and social studies. These four items, in faot p are seen as 
the poorest academic areas for the students in the sample. Average 
ratings on these items and on most others reflect general academic 
performance more than two grade levels below the norm for these 
children. 

Post test data showed relative gains on only one performance 
area, handwriting. This improvement, represented by a mean increase 
from 1.20 to 1.70, was statistically significant beyond the ,05 
level* Five other items showed shome change from pre- to post- 
measurement, but all were in a negative direction, Reading, oral 
language, written language, arithmetic, and spelling all showed 
slight decrements in relative performance. The science and social 
studies items showed no mean changes, 
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Table 01, Jc 

Pre- Post-Intervention Changes in Teachers' Perceptions 
of Secondary Pupils' AeMemie Behavior 



' Pri-Tist 



Post-Test 



N Mean 3D Mian SB 



Mean 
erince 



Correlation 



Reading 



11 1,45 .93 1.18 .10 



.27 



,81 



Oral 



ge 



11 . 1,81 .98 \M ,68 



Written 



Spelling 



Seienci 



11 1,2? M 1,09 ,30 



Arithmetic U 1J8 ,40 LOO ,00 



11 1,27 



1,18 ,10 



Handwriting 10 1.20 .6) 1JO M 



9 1,11 ,33 1.11 ,33 



.18 
,18 
,09 
-0,50 
.00 



,88 



,67 

,21 
LOO 



Social 
Studies 



9 LU .33 1.11 .33 



,00 



•0.12 



Summary 



Systematic changes in pupil performance were not perceived 
by teachers in the three school levels. In general, teachers per- 
ceived initial student performance considerably below grade level, 
and this relative measure worsened as children progressed through 
the grades, The significant changes which did occur were not 
consistent across grade levels and were not always in a positive 
direction, The intermediate level children were somewhat mixed, 
and secondary children, with the exception of handwriting, regressed 
further in perceived grade level standing, Pre-post correlations 
indicated that reading, written language, arithmetic, and spelling 
skills were measured consistently by teachers. These coefficients 
ranged from ,48 to .88 across all grade levels. Thus, it is 
probable that the small number of significant changes noted in the 
data was not primarily due to the unreliability of the measurement 
procedure, ' 
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Work Samples.. .,00. 

A random selection of work sample! was analysed by the project 
evaluators following the conclusion of the school year. Forty* four 
separate samples were selected for the analysis. All of the samples, 
except one, were in the arithmetic and reading areas. Our inspection 
of the samples revealed that their utility as an evaluation device was 
very limited. They were structured tasks f requiring prescribed re* 
sponses, but the complexity and size of assignment varied greatly from 
pre- to post- intervention. Teacher evaluations of the work samples 
were not very systematic and were only made infrequently* Therefore, 
we had a great deal of difficulty in defining any meaningful improve* 
ment index for the data presented. The use of work samples for both 
feedback in instruction and as evaluation instruments in the Title VI*G 
project was not well enough defined to produce any meaningful data, 
The major conclusion that can be made based upon the data in the work 
samples is that much more structure is nteded to make them worthwhile 
evaluation devices, Also f the project staff indicated that work 
samples should bp formative measurement devices and should be required 
at least once every two weeks to serve as feedback both to the referring 
teacher and the consulting project staff member* 
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Wide Rang e Achievement Tests Reading. Math, and Spelling 

Insert Table If. l. 3a 

The results of the pre-poat WHAT achievement test scores for 
primary students are presented in Table I. 1, 3a, All of the in- 
creases for reading, arithmetic, and spelling were significant. The 
primary students were involved in the project for an average of 6 and 
(one-third months. Their progress during this time was 6,2 months in 
reading, 7.6 months in spelling, and 6,2 months in arithmetic. This 
indicates that while in contact with the project interventions, the 
students gained at least one month aohievemet for one month of 
instruction. This result is a favorable one in light of the student's 
lower rate of achievement prior to the project. The correlations 
between pre- and post scores were ail significant indicating that the 
changes observed were consistant across this group. 

Insert Table II. 1. 3b 
The pre-post WHAT achievement test scores are presented for 
intermediate students in Table I, 1, Jb, All of the improvements for 
reading, spelling, and math were significant. The intermediate students 
were involved with the project for a period of 7 months. Their progress 
during this time was 7.2 months in reading, 9.3 months in arithmetic, 
and 4,1 months in spelling. Their gains while in contact with the 
project were 
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Table IL3a 

H's, Means, Standard Deviations, Correlations, Difference Scores and 
Critical Ratios of Pre-Post Wide Range Achievement Teats 
for the Primary Students 

Preheat Pfl3t»Test Mean Critical 

Item | ian |3 Mean 3D Difference Corral 



ReadiniSridi 26 hfl t % 2,33 1,07 *0*6 ,?9 4.88** 

Spelling Grade 26 1,38 1,15 3,1) ,91 -0,75 .56 3,92 *» 
Arithmetic 

a 26 2,00 1,0? 2,61 i.oi -0,61 ,75 U8*# 



AMnistration 26 50,5? 19.15 17*.B8 4,76 415,34 -0,54 11.33 



KEfi * = indicates a statistieally significant difference = ,05 
#* a indicates a statistically slpifieant difftrinQe = .01 



; K 1 if Means ( Staidari Diviatioai , Gorrslations , Difference Scons 
fssts for Intemidiati Students 



Si N .;; Hs8H 3D 



Readin 
Level 



Pre«!iit 



Post-fist' 



26 2,28 ,90 3.00 1.21 



Mian 



JD Difference Correlation 



■0,72 



.89 



Critical 



6,48 ** 



Spelling Grade 



16 2.00 , 57 Ml M 



.78 



1,01 ** 



Grade Level 15 2,85 .8} 3,78 ,85 



Administration 26 J0,^ 172,11 1,6) 



■0,93 



430,80 



.55 



,0.08 



5,84 ** 



21,83 



W\ * a indicates a statistically sipif ieant difference m ,05 
** s indicates a statistically significant differaci = ,01 



• Table U»3c ... 
N f 3| Mtana j Stw]^^ Difference Scorn v-J 



Item 



Fr§*feat 



Post-Test 



Mem 



Critical 



J Mean 3D lean y^. ; SD , Difference Correlation Katie 



Reading -Grade 



23 •;:- , ^iS,V-2iO*. ; -V-;fcfe I A 



-0*2^ 



.81 



.99 



Spelling Grade 
Level 



21 3,39 1,01 3J5 1,03 



-0.K 



.77 



2,81 ## 



Arithmetic 
.Grade Level 



IT 4 J 1,28 4.71- 1.03 



■0,31 



.79 



1,66 



Day of 

AMniBtration 



21 100,38 .55.12 169.37 \A 



-68,79 



.31 



6,25 



KE5ft * « 



as a 'statistically sipifieint difference s .05 
i a statistically sipifieint difference i ,01" 
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over one-month achievement for one-month of instruction for both 
reading and arithmetic* In these two areas student achievement 
rate was above that observed prior to project intervention* The 
inter-test correlations were significant indicating the changes 
observed were consistent across the group* 

Insert Table I. 1,3c 

The pre-post WHAT achievement test scores for the junior high 
and high school students are presented in Table 1,1, 30* The spell- 
ing grade level change was the only significant increase observed for 
the student group*' The junior hi^i^high school students were in con- 
tact with the project for 3 and two^thirds months, Their progress dur- 
ing that time was 2.4 months in reading, 4,6 months in spelling, and 
3*1 months in arithmetic* Their rate of change approached or exceeded 
one*month gain for one-month instruction for both the spelling and 
arithmetic scores* The rate in these areas of achievement was well 
-above- the student achievement rate prior to the project. The pre- and 
post-achievement test scores were highly correlated indicating that 
the changes observed in all areas were consistent across students, 

The WHAT scores improved significantly for 7 out of 9 variables 
measured pre-post across the student groups, The achievement gain ratio 
was equal to or exceeded one month's achievement for one months in- 
struction for 7 of 9 variables as well, All pre-post measures were 
significantly correlated indicating that when changes occured they 
were consistent across the student groups. Both tha primary and 
Intermediate groups made the largest gains overall but they also were 
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iliypived with the pro jeot f or a much longer time (3 and /^-thirds 
TOrrihs ■■■y*. 6 months) As all of the pupils involved with the project 
ware to some decree below grade level their increased achievement 
per-month was a favorable outcome. Both the intermediate and jynior- 
high school students were still well below grade level eweotaneies 
at the end of the program. This is not the fault of the project but 
indicates that more time must be allocated for intervention in order 
to close such a large achievement gap, It is also passible that 
catching up with peers may be an unrealistic goal for all students . 
Instead we might work towards mastery of survival academic skills . 
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Introduction 

The rated assessment tasks in reading and math were administered 
pre- and post- project intervention* Rate of response was determined 
by dividing the number of correct and error responses separately, by 
^he number of minutes taken to complete the task, A correct and error 
rate per-mlnute is presented in the table for each of the tasks. 
Every table includes information as to the specific tasks assessed by 
level , sample size, pre- and post* mean correct rate, pre* and post* 

mean error rate, pre* and post*stsndard deviations, correlations be- 

- : • . . * ..... ... ..." . , 

tween the pre- and post*measures, the mean difference between the pre* 
and post-measures, the critical ratio, significance level of the 
change, the percentage of correct responses, and the accuracy ratio, v 

The discussion of the data reviews the significant or nearly 
significant shifts in the data, All the data were analysed to 
determine if a master level had been achieved* Mastery levels are 
rates of correct and error response that indicate a student has 
achieved proficiency in a specific still area, When mastery is 
reached no further training is necessary, Tables of mastery levels 
are provided in the Appendix, The mean correct and error values for 
each skill were oospared to the mastery level prescribed on the tables. 

The accuracy ratios are also presented in order to provide 
information as to the relation between correct and error rates, Aeour* 
aey ratios are calculated by dividing the larger of the rates by the 
smaller of the rates, The percentage of accuracy is then determined 
by dividing the correct rate*minute by the total number of responses 



made per*minute (correct rate + error rata). For example, if the 
eorreet rat© is 2/minute and the error rate ia 1/rainute accuracy ratio 
would be 2/1 - 2 and the percentage of accuracy would be 2/3 or 
66 2/3^* If the eorreet rate is larger * then the accuracy ratio 
assumes a times function which is denoted by an X (in our example, we 
would have a 2X), If the error rate ia larger, then the accuracy 
ratio assumed a divide-by function which is denoted by an 4* (If 
errors were 2/minute and correct rate was 1/minute the accuracy ratio 
would be f 2). 

In the discussions which follow, results from the rated assess* 
ment of oral reading using a form of toe Oilmore Oral Reading Test 
(see Form L in the Appendix) are incorporated under the overall re- 
sults for reading achievement, objective Jl*3 immediately following* 

Rated Assessment - Reading (Form J) 
Insert Table Jl*3a (Part One & Part Two* Pp. 51-52) 

The results of the pre*post rated assessments of oral reading 
skills for the primary students are presented in Table Jl,3^ (Part One 
& Part Two). Significant increase in the correct rate was obtained for 
alphabet recognition* Decreases in the error rates were significant for 
reading 4*letter*mixed-medial vowel words and dolch sight words* The 
decrease in error rate for 5*letter*mixed-mediai* vowel words also 
approached significance* There were highly significant correlations 
between correct rate measures (pre-poet) indicating that the changes 
observed in this variable were consistent across the treatment group. 
Error rate correlations were also high for the area in which a slgni* 

f leant change was observed, again Indicating a consistency of change in 
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this area aoroas the treatment group. None of the apeeifie skills 
were at a mastery rate, Accuracy ratios and percentage of accuracy 
Improved for 6 or 7 variables aaaeaaed. This indicates that students 
improved in accuracy of response as wall aa speed of response. The 
oral reading level of the primary group overall was at the 2.1 grade 
level. Their oral reading rate at this level was only correct - 
9 errors / minute, These levels indicate that a great deal of remedia- 
tion remains to be done in all of the reading areas. Proficiency has 
not been reached in any of the reading subskills nor in reading in eon- 
text. 

Insert Table Jl.Jb (Part one & Part Two, Pg. 54) 
The data from the pre-post assessments of oral reading skills for 
intermediate students is presented in Table Jl.Jb (Part One & Part Two). 
Significant increases in correct rates were obtained for all reading sub- 
skill areas including alphabet' reading, >, 4-, and 5-letter-mixed-medial. 
vowel words, A signif leant reduction in the error rate of >letter- 
mixed-vowel words was also obtained. All the correct rate results were 
significantly correlated from pre to post. The correlation for the 
pre-post error rate results was also high in the area in which a signi- 
ficant change was observed. This decrease was also consistent across 
the treatment group as well. None of the specific subskills were at a 
mastery rate. Both the accuracy ratio and the percentage of accuracy 
improved for all six variables assessed. Therefore improvements in 
accuracy accompanied increases in rate for all of the reading areas. 
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i% Means, Standard Deviations » O^tlatieni, Wfferenci Seorei 
' and Critical Ratios of Pre-Poit Rated Jsisssswti in 
: Reading for Primal Studtnts 





s 


Pre-Teat 
Il 1 


Post-Test 
Mean SD 


m 

Difference 


Correlation 


Critical 
Ratio 


Alphabet 
Recognition 


C24 
E 24 


mi 

3J 


23.83 

'2,61 


55,54 

3,00 


24,92 
', 2.76 


-7.15 

' .58 


.90 

.59 


3.25 ** 
1.17 


>Uttsr Mixes- 
Medial Vowel 


C 19 
119 


10,68 
7.15 


16.26 

1.12 


5.21 


13.30 
3.39 


-0,56 
1.94 


• 

.21 


• ,28 
1,70 


4-Letter Mixed* 
Medial Vowel 
Words 


c 9 
go 


u.44 
6.77 


■ 18.11 

3.73 


: 9.77" 
3.22 


8.77 
1.78 


1.66 
3.55 


.87 
-0,02 


< ,44 
2,54* 


5-Letttr Mixed* 
MiEM Vowel 

worus 


05 

a 5 


12,20 
11.20 


12.77 
7.59 


15.10 
5,00 


13J2 
2.54 


-3.20 


i 

.92 

71 
• f -L 


1.35 


Doleh 
Words Mat 


E 23 


».00 
7.21 


26,68 

5.96 


44.69 
3.91 


24.68 
2.72 


*5.69 
3.30 


.62 
.41 


1,22 

2,91 #* 


Oral Reading 
in Context 


522 
0 22 
E22 


2.M 
26.68 
8.18 


"1.3B 
24,77 
4.4? 


2.13 
32.59 
7.50 


.94 
22,28 
5,80 


=0.09 

-5.90 
.68 


.91 
,78 
.46 


,69 

1.75 
.73 



W, C s correct reati/fflinuti 
E = error rat 
6 s grade level 



# s indicates a statistically significant differenei 5 ,05 
** = indicates a statistically significant difference a ,01 



I© 



: \':! • 



Variable 



Alphabet Recognition. 

}• Letter tad-Medial 
Vowel Words 

j- Letter Mixed-Hdeial 
Vowel Words : 



Vowel Words 



Dolcb Words 
.Oral Rtadini Hate 



Aeeuraey Ratios and Percentages of Accuracy, for the Bated 
in Raading of Prima^r Students 



Aeeuraey Ratio 

a.5 , 

1,7 

n,i 

X5.'t 



Aeeuraey 

93 



6o 
ft 

?? 



Atfwaoy Ratio ferointage of 



118,5 



32,13 

13,08 



95 



75 
75 

81 
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The oral reading level for the intermediate group was at the 2.4 grade 
level. Their oral reading rate at thi§ level was 53 correct -^77.7 errors 
/ minute. These levels are well below the s^ade level expectancies for 
these students. The rates on the speoi?io reading subskills and the 
reading-in- context rate both indicate remediation must be continued. 
Insert Table J!. 3c (Part One & Part Two, 56,57) 
The pre-post rated assessment data for the junior high-high 
school students iu presented in Table Jl,5c (Part One & Part Two)* There 
were significant increases in the correct rate for 3 and 5 letter-mixed- 
medial* vowel words, and words read in oontejrb, The correct rate increase 
for 4 letter-mixed-medial vowel words and words read in context also were 
very close to being significant* The prt-post correlations for all 
phonic subskills were significant* Therefore, the changes observed were 
consistent across all members of the group* Accuracy ratios and percen- 
tages of accuracy improved for 5 of 6 variables assesuad* In almost 
all eases improvements in speed of response was associated with improve- 
ments in accuracy* The oral reading level for the junior high-high 
school group was the 4*4 grade level, At this level their oral reading 
rate was 83 words correct - 4*5 errors/minute* The oral reading rate 
obtained by this group approaches a mastery level (100 words correct - 
0-1 errors/minute) for words read in context* Other reading subskills 
were below a mastery rate, 
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Table Jl.Jb (Part One) 



N's, Means, Standard Deviations, Correlations, Difference Seoras and 
Critical Ratios of Pretest Rated Assesement of Reading 
for Intemediiti Students 







Pre-Tsst 


Post-Ti 


ist 


Mean 




Critical 


Item 


I 


Mean JD 


Mean 


1 


Difference 


Correlation 


Ratio 


Alphabet 
Rtoognition 


0 25 
E 25 


69,80 2.6.41 
3. J «3 5.35 


76,04 
1.56 


17.33 

1,52 


-6,34 
1,84 


.69 
.16 


2.35 * 
1.73 


^Letter Mjted- 
Medial Vowel 
Words 


0 25 


19.6V 13.75 


24,04 


14.79 




.92 


3,85 ** 


Uetter tod- 
Itedial Vowel 
Words 


G 21 
121 


llj 13.05 
9,42 6,62 


17.95 
7.90 


12,79 
8,09 


-3,5? 
1.52 


.90 

.49 


2.94 *# 
• .93 


5-Letter Mixed- 
Medial Vowel 
Words 


C 15 
S 15 


11.66 10,62 

m 4,85 


17.66 

m 


15,23 
2,89 


-6.00 
1.80 


.93 
.60 


3.51 ** 
1,80 


Men * 
Words list 


C 25 
E 25 


49 s g4 23*15 

7.12 5.73 


52.88 

6,32 


25.50 
5.11 


-3.64 
.80 


.72 
.18 


1,00 
.57 


Oral Ming 
in Gontf xt 


G 26 
C 26 
E 25 


2,38 .89 

51.00 27.72 
■7.00 6,29 


m 
53.61 
7.68 


,81 
29.20 
5.58 


-0.07 
-2,61 
-0,68 


•95 
.88 

.25 


1,44 

.95 
,46 



KEY: C = correct rate/minute 
E * error riti/mnute 
0 3 grade level 
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M * s indicates a statistically significant difference * ,05 
** = indieatis a statistically significant differenos * ,01 
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Table Jl.Jb (Part Two) 

Aeeuraey Ratios and Peroentages of Aoouraey for the Rated 
Asstssiints In Reading of Intermediate Students 



Pre-Teat Post-Test 
AoQuraey Ratio Percentage of Aceuraoy Bstio lereentage of 

Accuracy Aac 



Alphabet Reeognltion 10,5 95 
>Litter tad-MidM 

Vowel Words 1,0 6? X3.38 77 
ko Letter Mxtd-Msdlal 

Vowel Wordi H,§ 60 X2.2J 69 
yi S-Ltttff Mxtd-Midial 

y Vowel Words 3Q.8 64 X3.79 79 

Doleh Words X0.9 87 xB.Jf 

Oral Reading Rate 17,1 88 X6.98 
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Table Jl.jc (Part One) 

N'a» Means, Standard Deviations, Correlations, Difference Scores 
and Crltieal- Ratioi of Pre-Post Rated Asssssients in 
Heading for Junior High-High School Students 









t 


Poet-Test 




Mean 




Crltieal 


Item 


N ' 


Mean 


3D 


Mean 


1 


WffiriMi 


Correlation 


Ratio 


Alphabet 
Recognition 


0 21 

121 


86.14 

2,52 


20,03 
2,27 


81,85 
1.09 


18,06 

1,99 


-1,71 
1,42 


.92 
.57 


1.05 
5.29 ** 


3-tetter MM- 
Medial Vowel 
Words 


C 27 
12? 


50.51 
12,85 


20,19 
6,52 


55.25 
8,07 


18.01 
5.60 


•4.74 
4.77 


.94 
.56 


5.56 ** 
4.32 ** 


ft-Utter Mixid- 
Medial Vowel 
Words 


G 26 
126 


50.42 
13.26 


21,05 , 
6.74 


35.65 
10,15 


21.52 
6,29 


■5.23 
3.11 


.90 
.42 


1.77 
2,26 * 


^Letter ted- 
Mesial vowel 
Words 


w u 
E 22 




ill 

7.76 


11.00 


ID, (□ 

6,53 


3.54 


.59 


k 7 A ## 

2,54 ** 


Dolch 

Words List 


C 2? 
E 27 


75.18 
4.51 


19.63 

4$ 


73.14 
5.11 


2lJ 
15.61 


2,03 

-0.59 


.55 
-0.07 


,49 
,18 


Oral Reading 
in Context 


G24 

c 25 

125 


4,35 
74.20 
6.76 


2.05 
31,18 

3.S3 


81.96 

m 


2.08 
50.74 
5.59 


-0,04 

-7.76 

2.28 


.99 
.78 
-0,05 


1.00 
1.92 
2,11 



M\ G - correct rate/ffiinute 
E a error rate/iinuti 
5 m grade level 



* § indicates a statistically significant differgnei = ,05 
** m indisatas a statistically slgnifioant diffirenoi ~ .01 



Uariable 



Alphabet Reeopitisn 

Hitter Exed-Medial 
Vowel Words 

^Letter tttad-Medial 
Vowel Words 

5-Letter MlxefrMedial 
Vowel Words 



Doich Words 



Oral Reidini Rite 



Table Jl.* (Part Two) 

Aeauriey Ratiei and Percentages of Accuracy for the Ratsd 
Assissients in Reading of Junior Hlfh-Righ School Students 



Prf-Tist 



Poet-Teat 



Accuracy Ratio Percentage of Accuracy Ratio 



$.0 
X2,37 

12,29 

X1.52 

20,98 



to 

70 
TO 
50 

92 



xSo.ao 

1,50 

nk t % 



Percentage of 
Aceuraey 

99 



77 

71 
93 
95 
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Suniqary 

The results show that significant changes were found for 15 
of the 27 measures of oral reading subskill across the treatment 
groups , Accuracy ratios and the percentages of accuracy improved for 
17 of 18 variables assessed, This indicates that the students im- 
proved in both their speed and accuracy of responding. They read both 
more rapidly and made fewer errors proportionately. 

The intermediate and junior high-high school students 1 data 
produced a majority of these changes, This could indicate that the 
reading approaches presented by the project staff are more effective 
with older and more retarded readers but regression towards the main 
could also be used to e^qplain the results. As the older students were 
more regressed from their respective mean groups, larger changes 
could be ejected from the older group as well, 

The average scores obtained on all of the measures asross all 
of the groups were below mastery levels. Mastery levels indicate 
when training is no longer needed and are defined by a combination of 
correct and error rates (Alper, 1973; 197^)* Their oral reading 
levels were also well below expecteney for all of the groups, Remed- 
iation procedures should be continued for a majority of students in- 
volved in this program* 



345 



58 



Rated Assessment - Math (Form K) 
Insert Table KL»3a (Part One & Part Two, Pg, 60 s 61) 

The results of the pre-post rated math assessment of primary 
students are presented in Table Kl*3a (Part One & Part Two.) Correct 
rate increases were significant for number reading 0-100, counting 
sets of dots 0-9, and subtraction remainders 1-18, There were no 
significant decreases in error rates, but reductions in errors did 
occur in 7 sf the 8 variables assessed* The correlations between 
pre-post correct rate data were significant for 6 of 8 areas. The 
changes observed in the correct rates were, therefore, fairly con- 
sistent across the treatment groups, Accuracy ratios and the, 
percentages of accuracy increased in 7 of 8 cases, This indicates 
that students improved in speed of response as well as accuracy of 
response for a large majority of the variables. In no case did the 
average c or r e c t- error rate obtained for any of the variable approach 
a mastery level. Training in all variables should therefore, be 
continued for a majority of the members of the group, 

Insert Table Kl,3b (Part One & Part Twc* s pq. 62,63) 

Table Kl.Jb (Part One & Part Two) presents the results of the 
pre^post rated assessments of math skills for intermediate students. 
There were significant increases in the correct rates for number 
reading 0*100, double-digit addition with carrying, and double-digit 
subtraction with borrowing. None of the incorrect rates showed a 
significant increase or decrease, The correlations between pre- and 
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Table Kl.Ja (Part Ons) 

N's, Means, Standard Deviations, Correlations, Difference Scores and 
Critical Ratios of Ire-Post Rates Assessments in Matt 
for Primary Students 
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Pre-Te 


st 


Post-Ti 


st 


Mean 




Item 


N 

** 

C 25 
E 25 


Mean 


3D 

21,60 
S.JO 

lit 11 


Mean 


i 


Differinee 


Correlation 


Oral Counting 
0-20 

Ural UQUIluing 

1400' 


48*16 
6,56 


. 49*96 
5.20 

T5-40 


22,8l 

4.68 


4.80 
4,81 


.83 
,74 

.86 


Counting 
Sets 0*9 


C 25 
E 25 


.92 


7,16 
2,08 


23,40 

.24 


7.04 


.68 


.79 
,10 


Addition Sums 
148 


C 24 
I 2k 


9.25 
3.5* 


7-64 ■, 
5,42 


10*16 
2,58 


7,60 
5.78 


-0.91 
.95 


.77 
.07 


Double Digit 
Addition- 
Carrying 


C 11 
Ell 


9,09 
M* 


7.02 
6.25 


9.63 
2,45 


7.90 
3il 


-O.54 
1.09 


.39 
,11 


Subtraction 0 22 
Remainders 148 E 22 


6.2? 
5-72 


4,07 
8,82 


7.40 , 
3.72 


4,51 
0,32 


4,13 

2,00 


.83 


Double Digit 
Subtraction- 
Borrowing 


0 8 
E 8 


1,87 
3.50 


2.7* 
6,11 


3.25 
2.37 


2,96 
3,06 


4,37 
. 1.12 


.61 

.36 


Single Digit 
Multiplication 


"C 5 

8 5 


7-20 
2,60 


3.19 
3.97 


8.20 
11.40 


4,38 
IB.?? 


4,00 . 
-8,80 


,10 
.31 


KEYi C = correc 
S s error 


it rateMnu" 
rate/minuti 


te 













* « indicates a statistically significant difference = ,05 
** 3 indicates a statistically sipifieant difference * ,01 



Table Kl,3a (Part Two) 

Aoeuraey Ratios and Percentage! of Aocuriay for the 
Rated AssisaDiinti on Math of Primary Studenty 

Pre-Teat Pggt^Teit 
Aesuragy Ratio Percentage of Accuracy Ratio " " Percentage of 

Oral Counting X6,9 88 X9.6 Qi 

0-20 

Oral Counting X7.3 88 X9.3 91 

1*100 

Counting Seta X21.9 86 X97,5 QQ 

0- 9 

Addition Sums 1 x 2,6 72 35,94. 80 

l*lo 

m Double Digit Addition. _ X2.6 72 13,93 80 

■» Carrying 

Subtraction Rsaaindera n.l 52 XL 99 66 

1- l8 

Double Digit Subtraction H.9 . ■ 38 nM $ 

Borrowing 

Multiplieation X2.8 73 41,39 1| 2 
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Tsblt K1.3b (Part One) 

N's, Means, Standard Deviations, Correlations, Difference Scores 
and Critical Ratios of Pre-Post Rated Assessments in 
Math for Junior Hi^-High School Students 



Pre-Teat 



lost-Test 



Mian 



51 



KEY; a C s correct rate/ndaute 
E s error rate/minute 

* * indicates a statistically sipif leant difference a ,05 
** s indicates a statistically significant difference s ,01 



Critical 



Item 


I 


Mean 


BD 


Mean 


3D D 


iff crenel. 


Correlation 


Ratio 


Addition Suns 
1-18 


c6 
16 


27.83 
,66 


,81 


29.83 
.66 


1U0 


-2,00 
.00 


.80 
.87 


.57 
,00 


Double Digit 

Addition* 

Carrying 


c6 

E6 


19.16 
.66 


7,l6 
1.03 


2^.33 
1.00 


11.14 
L26 


-5.16 
•0.33 


.74 
.61 


1.6? 
.79 


Subtraction 
Remainders* 

1-18 . 


C6 
b6 


12,00 


5.^7 
1.16 


20.16 
3,16 


9,84 
3.06 


.8.16 

■1.33 


.93 
,62 


3.91 ** 
1,30 


Double Digit 
Subtraction- 
Borrowing 


13 


7.60 
2,80 


6.8? 


ll.BO 
2.40 


7,82 
3.37 


4,20 
,40 


.77 
,61 


1.8? 
.25 


Single Digit 
Mtiplieation 


C5 

E5 


21.10 
2,20 


9.78 
2.28 


20,00 
2,20 


9.05 

1,64 


1.40 
,00 


.89 
.85 


.70 
,00 


Double Digit 
Mtiplieation 


04 

Ik 


8.00 
2.00 


1,63 
2.30 


13.75 
3,00 


5il 
3*55 


-5.75 
4,00 


.79 
.81 


2.59 * 
.92 


Single Digit 
Division 


c4 

Ik 


19.00 
2.25 


12,72 
3.30 


19.25 
2.75 


8.73 
1,70 


-0.25 
-0,50 


.85 
.72 


.0? 

.42 


Double Digit 
Division 


ca 

12 


7,00 
1.00 


4,24 

1,41 


11.00 
LOO 


9.89 
1,41 


4,00 
.00 


LOO 
LOO 


LOO 
2,00 
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::;,^ v .iili-Jb (Part Two) 

Accuracy Hatios and Percentagts of Accuracy for the 
Rated Assessment! on Math of Intennediate Students 

Prg-TiSt pggt^Tsst ■ 

<ff Ratio .... Percentage of Accuracy -Ratio" Percentage of 



Accuracy 



Accuracy 



Oral Counting ' ^ ' , ! 

> 20 119.9 95 X22.95 96 
I; : Oral Counting 

I l " 100 3Q8,4 95 . X22.81 96 
|: : Addition Sisna 

f 148 X682,7 99.8 Xf4,25 99 
f :' : Double Digit Addition* 

I Carrying X3,6 78 X13.03 93 
Subtraction Remaindfrs 

Double Digit Subtraction 

(v; 67 X2.26 69 
Single Digit 

Mtiplisation XB.Q 89 x6,62 . . 8? 
Double Digit 

Multiplication JQ.8 fill X2,48 ■ 71 

: y Single Digit Division, -ijj 79 ^7 ^ 

■ ' Double Digit Division *3«3 23 ^ og ^ 
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post-rates were significant on 8 of 11 cases. This indicates that the 
affects of the interventions were homogenius across the treatment 
group* Accuracy ratios and the percentage of accuracy improved for 
6 of 11 variables* Therefore, for the intermediate group an increase 
in speed of response was not always accompanied by an increase in 
accuracy. The average rates obtained by the intermediate students 
were below mastery levels for all skills, Further remediation would 
therefore be necessary for a majority of the members of this group 
on all of the variables assessed. 

Insert Table Kl.Jc (Part One & Part Two, Pg, 65-67) 
The data from the pre-post rated assessments of math skills for 
junior high and high school students is presented in Table Kl.Jc 
(Part One & Part Two), There were significant increases in the correct 
rate for subtraction remainders 1^18 and multiplication with carrying* 
Subtraction with borrowing was also close to being significantly higher 
in correct rate* There were no significant differences in error rates. 
The correlations between pre* and post-test rates were all significantly 
high, The correct rate increases were, therefore, consistent across the 
student group, Accuracy ratios and the percentage of accuracy remained 
the same or increased for 4 of 8 variables. The increases in speed 
observed were again not always followed by increased accuracy for this 
group as a whole. The average rates obtained *by the junior high^high 
school students were at, or close to, mastery for single digit addition 
with carrying. All of the other variables were below mastery levels 
for the specific skills, Training on all basic computational skills be- 
sides addition should therefore be continued for a majority of the 
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students in this group. 
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C 13 


Multiplication 


1 13 



N's;; Means, Standard Deviations, Correlations, Difference Scores 
and Critical Ratios of Pre-Post Rated Assessments in 
Math for Intsrmediati . Studants 
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.83 


15,11 
.91 


19,00 
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2.46 


-0,83 
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.95 


.73 
.15 


12.19 
1.47 


10,85 
2,l8 


11,76 
2.85 


8,42 
5.15 


,42 
4,38 


.74 
.17 



3.57 


4,97 


6,28 


5.62 


-2.71 


.69 
.07 


1,78 


2,72 


2.78 


4.97 


4,00 


16.05 


11.77 


16.76 


13.17 


-O.70 


.39 


2,05 


3*91 


2,52 


3.39 


-0,47 


,80 


5,00 


5,81 


7.53 


6.64 


•2.53 


.48 


2,84 


w 


3.07 


4.76 


•0,23 


,60 



Item 


I 


Ire-Test , 
Mean JB 


Post-Test 
Mean SD I 


Mean 
WLffartncs 


Critieal 
Correlation Ratio 


Division 


c L." 
e a 


12.50 7.65 
; 3.57 6.52 


13.87 
3.75 


8,60 
7.85 


-1.37 
-0.37 


.69 .61 
$ .57 


Division 


C7 
17 


1.57 2.11 
5.28 73 

: \ - 


Ml 

4,00 


3.86 
7.00 


1.28 


,ol 1.50 

.87 . M 



Mt C § comet rstg/binuti 
E = error ratsMnite 



* a indicates 1 statistically significant difference = .05 

* = indicates a statistically significant difference s ,01 
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f able K1.3e (Part Two) 

racy Ratios and'. Percentages of Aeeuricy for the 
Rated Assessments on Math of Junior High-High School Students 



Pre-Tiit 



Aecuraoy Ratio 



Post-Test 

Percentage of Aoauraoy Ratio Percentag e of 
Accuracy • Accuracy 



Addition Sums 
148 



141.75 



.75 



98 



Double Digit Addition* 



97 



A)) 



95 



Subtraction-Riinaindirs 

1-18 



X6.55 



8? 



X6,37 



86 



Double Digit Subtfiotion- 
Borrowing 

Singlt Digit 
Multiplieation 



X9*92 



73 



91 



Iks 



X9.09 



83 



90 



Double Digit 



Single Digit" Division 
Double Digit Diviiion 



X4.( 



8o 



A.5B 

X7.00 

in, oo 



82 



92 



Ml 
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Summary 

The rated math assessments provide evidence of significant 
changes in eight specific computational skills s All the significant 
changes were increases in the correct rate of performance* Error 
rates overall showed slight increases or slight decreases but there 
were no significant shifts. Accuracy ratios and percentages of 
accuracy increased or remained the same for 18 of 25 variables measured* 
In approximately two*- thirds of the variables speed increases were 
accompanied by accuracy increases for the treatment group* When changes 
were observed they were consistent across the treatment groups. The 
specific areas of change were related to the grade levels assessed. 
Students in the primary grades changed in the more basic skill areas, 
while intermediate and junior high-high school students changed on the 
more complex skills. This outcome is probably due to a differential 
emphasis in the interventions attempted in upper grade levels, The 
infrequeney of changes in error rates could be due to a restriction in 
the range of such scores* As errors approach zero they lost their 
sensitivity to the effects of remediation programs* Correct rates are 
more sensitive because they are less likely to approach their ceiling 
and therefore can reflect change over a longer period of time. As 
mastery levels were not attained on almost all the variables assessed* 
continued training would be required for a majority of the students* 
The rates obtained did increase by grade level but a majority of the 
group p at all grades, would benefit by further remediation in this 
area. , 
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OBJECTIVE TOO 

Development off EH teachers* skill in planning and implementing inter- 
vention for EH pupils and assisting other on-site staff in sharing the 
instructional responsibility * 

2,1 Translate diagnostic information and pupil progress into 
specific long-ra^ge (monthly) and short-term (daily) 
instructional activities. 

Three separate devices (Forms M, N, and 0) were utilised as 
post-intervention measures for this objective. These forms are de- 
scribed in the Appendix, In the following section the data from each 
of the forms is presented separately* A sunsnary section, highlighting 
the major overall findings, follows this discussion* , .... 

The data from the Competency Rating of Special Teachers are 
presented in Tables M2,la and M2,lb* This form was completed by the 
project staff as an evaluation for each of the special teachers who 
had a significant amount of contact with project personnel* Each 
item on the instrument covers a specific behavioral competency in 
pupil assessmentf pupil instruction, and behavior management* The 
form is divided into two sections* The. first section covers competen- 
cies in all the previously mentioned areas* The second section 
focuses on the special teacher f s competency in formal and informal 
assessment for ten separate areas, 

Items 1-17 (Section One) were rated on a separate three-point 
scale, unique for each item, In general a 1- rating indicated the 
teacher did not apply or did not know about the competency area, a 
2-rating indicated the teacher had knowledge of and used the competency 
skill to a limited degree, and a 3-rating indicated the teacher was 
competent in the skill and utilized it to a high degree. Inspection 
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of the actual, items is necessary, for each item, in order to deter- 
mine the actual wordings used (see the Appendix). There were two 
separate ratings for the asssessment areas presented in items 19-27 
(Section Two,; Each teacher was evaluated as to his ability in both 
formal and informal assessment for each area. A four-point scale was 
utilized for rating these items. The scale is presented in Table M2.1b. 

Competency Rating of Special Teachers 
Insert Table M2 .la 
Inspection of Table M2,la indicates that the project staff's 
average ratings of the special teachers' competencies (for Section One) 
were quite high overall. The average ratings for 16 of if items were 
2.5 and above. In 12 out of If items the average ratings were 2.75 
and above. As the scale only has a top point of three, the ratings 
approached a high degree in knowledge of and utilization of the com- 
petencies for almost all of the areas. The only item that was below 
the 2.5 level was "use of behavioral objectives for each student" 
(mean * 2.25). The standard deviations for 14 of the 17 items were 
low. This indicates that there was a low spread in the ratings across 
the group of special teachers. The items with the largest amount of 
variability in ratings were those dealing with the use of behavioral 
objectives, utilization of reinforcement programs for social behavior 
problems, and the utilization of reinforcement programs for academic 
problems. The project staff found overall that the average special 
teacher had knowledge of and applied the specific competencies in 
assessment, instruction, and behavior management measured by the form. 
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Table MZ.la 

Mea&A and Standard Deviations for Competency Ratings of 
Special Teachers by Project Staff 



Post Rating 

Competency jj Mean SD 

1, Selection of diagnostic instruments to 10 2,80 .42 
fit the ehilds* ability and/or disability 

aria 

2, Use of diagnostic tests results to generate 9 2 ,88 ,Y) 
individual pupil programs 

3, Use of behavioral objectives for ill 8 2,25 ,70 
areas for each student 

k, Individualization of pupil objectives 8 2 ,62 ,51 

in tens of this pupils' strengths and 
weaknesses 

5. Monitoring of pupil progress 8 2, 75 M 

6, Modification of instructional objectives 8 2,62 ,51 
based upon pupil progress 

7* Uses a wide variety of instructional 9 2,77 M 

approaches for the individual student 

8, Uses a wide variety of instructional .7 2,85 ,37 
approaches for groups of students 

9, Utilization of individual reinforcement 9 2,55 ,72 
programa for social behavior probleis 

10, Utilization of individual reinforcement 9 ,. 2.66 ,70 
programs for academic problems 0 



Coropetgnoy 

11, Involvement of the student in 
planning their own propim 

12, Utilization of other personnel in 
plannini and instruction for students 

13, Exhibit eonfidenoa in sharing ideas 
with other stiff members pupils work 
with 

Ik, Responsiveness to new ideas 

15, IdentifiQation of learning modalities 

16, Ability to looate and utilize risouree 
materials appropriate to clasa 

17 • Ability to locate and utilise resource 
personnel appropriate to class 



Post Rating 

8 Mean SD 

mm mmmm mm wwtw 

9 ' 3.00 .00 
10 ' 2,80 M 
9 2i88 ,33 

9 3.00 .00 

9 3.OO ,00 

9 2.88 .33 

9 2.88 ,33 
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Summary 

If the data derived were to serve as a needs assessment for 
future training, some tentative recommendations can be made. The 
special teachers do have the knowledge and ability to use a majority 
of those practices considered appropriate for education of the learn- 
disabled child. The greatest need in the future seems to be in the 
area of feedback and reinforcement for the teachers themselves. In 
order to move the ratings even higher and reduce the with in- group 
variability even more, systematic application of feedback and rein- 
forcement for use of their already good skills seems to be in order, 
Consultation should focus on what the teacher is already doing well 
and increasing their application of these approaches. Introduction of 
new and more varied skills might serve to weaken and confuse the 
teachers in those areas in which they already are receiving high ratings 

Insert Table M2.1b, Pg. 75 
Table M2*lb presents the ratings of the special teachers by 
the project staff on specific competencies In formal and informal assess 
ment. Again the overall ratings were quite high, None of the ratings 
was below 3 on a four-point scale, In the area of formal assessment 1 
devices the mean ratings for 9 or 10 items were 3*55 and above* On the 
informal assessment devices, the mean ratings were a'.l above 3*77* 
5 of 20 rating categories had 4,0 mean ratings! the highest score 
possible on the scale used. The standard deviation for 16 of 20 items 
were also quite low. In 5 of 20 rating areas the standard deviation 
was zero. This indicates that there was low variability in these high 
ratings across the special teachers on a majority of the items, 



The special teachers were systematically rated higher in co 
patency and use for the informal techniques (19 of 20 oases). This 
is not a surprising outcome as teachers utilize informal techniques 
on a much more regular basis than formal instruments. 
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Table 1,1b 

Muni and Standard Deviations for Competency Rating of 
Assessment Stills of Special Teaohtra by Project Staff 

Instrument Type 



Assessment Area 


N 


Formal 
Mean* 


SB 




Infos 


raal 

Qy 


l8, Bshavior 


y 




fill 
•04 


0 
? 


3*77 


,44 


19. Auditory Pereeption 


Q 
7 






Q 




ilil 


20 t Visual Perception 


Q 

7 




70 


9 


3-77 


,44 


21 1 Motor Devilopint 


9 


3,44 


.72 ■ 


9 


3.77 


.44 


22, Language 


8 






0 


;.0f 




2)* Memory 


■ ! 8 




7^ 
if J 


Q 

0 


3'fP 




24. Cognition 


7 
9 


4,00 
3.88 


.00 

-33 


8 

8 


3.87 

4,oo 


.35 
,00 


26, Math . 


10 


3.90. 


.31 


9 


kM 


,00 


27 Spelling 


10 


4,00 


,00 


9 


4,00 


,00 



RATING KEI: 

1, - Doesn't know of any inform! or formal methods in this area, 

2, - Knows of a single informal or formal method but does not utilize, 

3, - Knows of a single informal or formal method and uies with basic competency, 

4, - Knows of a variety of methods and uses one or more, with high proficiency. 



These ratings Indicate that the average special teacher served 
by the' project has Imowledge of and is able to apply at least one 
formal and informal assessment technique for all major areas of 
interest. The data provides evidence that many of the teachers are 
also able to apply more than one technique with a high degree of 
skill. Future training in assessment should therefore focus only 
very selectively on assessment procedures* A careful diagnosis of 
each teachers 1 needs prior to training would be necessary in order to 
avoid covering areas in which the teachers did not already have a 
high degree of toowledge and skill. 
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Special Teachers ' -Self -Rating 
The special teachers completed forms N and 0 at the end of 
their years contact with the Title VI project personnel. The content 
and construction of these forms is described in the Appendix. Both 
of these instruments were designed to serve as self assessment devices. 
The ratings on these forms correspond with the ratings given by the 
project staff on form M (Competency Rating of Special or Regular 
Teachers) . As similar areas are covered by these forms the corres- 
pondence of self -^ratings with outside ratings can be determined. In 
the following discussion the data for each of the forms (N and 0) 
are presented separately. A sunaiiary section presenting the corres- 
pondence between forms M, N, and 0 follows this presentation. 

Trainee's Self ^Ratin^ of Competency (N) 
Insert Table N2.1 , Pg, 80 
The mean ratings of competency by the special teachers were at 
or above the moderate skill level for 9 of 10 areas, The only item 
below this level was locating and utilizing resource personnel approp- 
riate to your needs (it was close to moderate, as well). The standard 
deviations of the ratings for item 2, J, 5, 6 ( 7 f 8, 9, and 10 were 
all three-fourths of a point and above. This indicates there was a 
large amount of variability in ratings for the special teachers on 
these items, None of the mean ratings were at or close to the top 
of the scale* The special teachers therefore do not feel they are 
expert in any of the competency areas, They did receive their high- 
est score on determining learning strengths and weataieases through 
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formal and informal assessments* This item fell between moderate and 
strong on the scale. 

Trainee's Self-Rating of Competency Change (0), Table 02,1, Pg, 82,83 
The mean ratings for competency change by the special teachers 
fell between some and moderate change for 9 of 10 items, Their iaghest 
perceived area of change was locating and utilising materials appropriate 
to your needs, The standard deviations of the items was quite high over- 
all* Therefore, some of the teachers rated their change as large and 
others rated their change as small, In no case did the mean ratings for 
the special teachers approach a high degree of change in any area. 

Summary 

The project staff rated the special teachers at higher levels 
overall than the self ratings would indicate, The project staffs 1 ratings 
were at or close to a competency level in all areas except the utilization 
of behavioral objectives and reinforcement programs, The special teachers 1 
ratings were at a moderate level and were significantly below a strong 
skill on almost all items. The variability . of the ratings was also higher, 
for the self- ratings of the teachers than for the project staffs * ratings 
of teachers* The project staff perceived a greater degree of homogeneity 
within the group of teachers than they perceived themselves. The greatest 
areas of convergence was that of assessment skills, Both self and outside 
ratings indicated the special teachers were at or very close to a com- 
petency level in assessment skills. The greatest areas of divergence in 
the ratings were in the use of behavioral objectives and the use of 
reinforcrment programs, The teachers saw this as a moderate skill area 
but the project staff rated the special teachers 1 as only being minimally 
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eompetent in their knowledge-application of these techniques. 

The areas of agreement and disagreement in these ratings again 
point to the need for a careful needs assessment prior to the incep- 
tion of any training program* The project staff can and does have 
different views of what the special teachers need in such training* 
In order to provide the greatest degree of overlap between services 
and needs a pre-assesament is required. 
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Table N2.1 



N's, Means, and Standard Deviations for the Special Teaehers 
Stlf»Rating of Competency 



Item N Mean 

1, Diteriking Learning Strengths, and' 11 3.5^ 
tfeataesses Through Form! and Infomal 

Assessments 

2, Identifying Learning Modalities for U 3,18 
Each Student 

3, Developing Realistic Academic 11 3,18 
Behavioral Objectives 

K Relating Student Instructional Programs 11 3,18 

to Assessment Information 

5, Utilizing Effective Techniques for 11 %ZJ 
Behavior Hsnagment 

6, Keeping Track of Student Rrogrtii 11 3,09 

7, Locating and Utilizing Rseourde 11 2,72 
Personnel Appropriate to Your Need 

8, Seating and Utilizing Materials 11 
appropriate to Your Need 

9, Structuring the Classroom Environment 11 ,3*00 
to Facilitate the Use of Resource 

Materials in the Individualization of 
Instruction 



10, Diviiepifif the Sharing of 11 3,2? 

Beiponsibili^ with Other School 
Personnel in Meeting the Needs of 
Learning Msablli^ Students 



RAM KEY: 1 - very little skill 
I - soei skill 
3 - moderate skill 
h ■ strong skill 
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Table 02,1 



N ! s, Means, and Standard Dtviations for the Special Teachers 
Self-Rating of Cofflpttiriey Change 

Item N Mean 

1» Detiiiining Liamini S^an^tha, and Ik 2,4? 
Weaknessis Throu^ Poroai and Informal 
Assassitnts 

2, Identifying Learning Modalities for 13 1,2) 
Each Student 

i 

5, Developing Realistio AGidiide 13 2*30 
Behavioral Objeetives 

4, Relating Student Instructional Program 14 2,42 
to Assessment Information 

5, Utilizing Effective feolffliquis for ^ 13 2*2} 
Behavior Managiffient-=- ; 

6, Eieping Track of Student Progress Ik 2,f8 

1, Locating and Utilizing Resourci Ik 2,78 
Personnel Appropriate to Your Need 

B, Locating and Utilizing Materials Ik 5.21' 
Appropriate to Your Need 

9, Structuring toe Classra Environ^nt I) 2.6i 
to Facilitate the Use of Resource 
Materials in the Individualizition of 
Instruction 



10, Dsvalopini the Sharing of 
Responiibillty with Other School 
Ptrsennel in Milting the Needs- 
of Earning Disability Students 

RATING KEYs , 1 - very little change 
I - eofflt change 
3 * ioderate change 
k « large ehangi 
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2,2 Organize space, time, materials, and type of instruction to the 
learning strengths of the pupils. 

The Checklist of Intervention for Special Teachers 
Tliis instrument was administered post- intervention to all special 
teachers who had a significant Mount of contact with the project* Each 
item on the checklist represented a specific approach to diagnosis, in- 
structional planning! teaching technique, instructional material, behav- 
ior management technique, or a motivational approach. The teachers rated 
each item on the form utilizing the following scale i 

1, That you used item prior to Title VI intervention, 

2. That the item is not appropriate to your teaching 
situation* 

3* That you feel you need more help for competency in use. 

4* That your understanding of item was furthered by Title VI 
and you will use. 

The responses to each item were tallied and percentages of responses 
In each category were calculated. Table P2.2 presents the item descrip- 
tions, the sample sizes* the rating categories, and the percentages of 
ratings by category* 

Insert Table P2.2, Pg. 85 t 86 
The data in Table P2.2 were analyzed to determine the model re* 
sponse percentages for each item* When there were ties in the data no 
model response was computed for the item. The following discussion 
reports the results of this analysis, 

Inspection of Table F2*2 intervention reveals that the model per- 
centage for the greatest number of intervention items (n»15) was category 
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Table P2,2 

Percentages of Ratings for Intervention Proqedures 
by fecial Teachers 



Intervention 


N 


1 


Ratir 
2 


3 


Pereint 
k 


5 


I, Behavior Itaafefflent Ttehniques 


13 


62 


0 


23 


15 


0 


2. Aeadeaie Csntracts 


11 




27 


36 


0 


0 


3« Behavior Contrasts 


13 




8 


23 


23 


0 


k t Leaming Centers 


12 


50 


17 


17 


17 


0 


5, Multi-Level Earning Materials 


12 


75 


0 


0 


. 17 


8 


6, Teacher Made Gaaes 


13 


77 


0 


0 


23 


0 


7, Materials From the Risourci Center 


1? 


15 


0 


8 


77 


0 


8. Individualized Instruction 


13 


77 


0 


15 


8 


0 


9, Infoml Diagnosis of Leaming Styiis 


12 


33 


0 


33 


33 


0 


10, Writing Academic and Behavioral Objectives 


12 


92 


0 


8 


0 


A 

0 


11, Rated Assessment PorfflB 


7 


0 


0 


57 


^3 


0 


12, Regular Staff as a Resource 


11 




9 ' 


18 


27 


0 


13. ■ Self-Concept Inventory 


12 


23 


0 


25 


50 


0 


14, TechniquiS for Utilizing Work Samples 


10 


30 


0 


'*) 


20 


10 


15, Behavior Observation Tichnlques 


12 


42 


0 


33 


25 


0 



387 

386 



ERIC 



Intervention 


N 


1 


Rating 

2 


- Peraent 
3 I 


Ji, Anabell Markoff Inventory 


a ' 


38 


25 


13 25 


If, Language Masters 


10 


50 


10 


30 0 


18, Vide Range Aehlivemint Test 


13 




0 


25 8 


19, Oilnsrt Oral Reading Test 


12 


33 


8 


25 17 


20, Slinprland 


10 


30 


10 


to 10 


21. Developental Learning Materials 


11 


73 


0 


27 0 


22, Task and Behavior Analysis 


7 


71 


0 


29 0 



m mm categories: 

1 - tot you used iten prior to Title VI intervention, 

2 - That the item is not appropriate to your teaching situation, 

3 - That you feel you need more help for Qorapitincy in use, 

k - That your understanding of item wis furthered by Title VI and you will use, 
5 » That you have mastered the item and are now using, 



one* This indicates that the special teachers taiew about a large involve- 
ment with the Title VI project staff. This is further supported by the 
fact that over 50|f of the special teachers made such a response on 9 of 22 
items . 

The largest proportion of special teachers rated three of the other 
intervention items as being ones in which they felt more training was 
needed for competency in use (rated assessment forms, techniques for 
utilising work samples $ and Slingerland) * There were only two interven- 
tions (materials for the resource center and self-concept inventory) for 
which the modal response indicated the special teachers felt their under- 
standing was furthered by the Title VI project, It should also be noted 
that there were no items for which the modal response indicated that the 
special teachers felt Title VI had helped them to master a technique. 
Also, none of the modal responses indicated that the special teachers 
felt the approaches presented by the Title VI project were inappropriate 
to their teaching situation, 

Sumenajy 

The largest percentage of special teachers rated 15 of 22 interven- 
tions as being previously taown to them. There were only 3 of 22 inter- 
ventions that their modal rating idioated as needing more training. 
In only 2 of the 22 cases did the modal response indicate that the special 
teachers felt Title VI had furthered their understanding of the interven- 
tions and that they would use it in the future* The special teachers did 
not find the approaches presented by the Title VI project irrelevant, 
These results are not surprising given the fact that many special teachers 
now have an extensive history of pre** and in-service training in special 
education approaches. They do indicate the importance of a pre-assessraent 
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of the teachers needs prior to the in-service training or consultation* 
Baled on such a needs assessment, training can be tailored to ihose 
areas in which interest is highest and the need for help is the greatest, 
The data from .Title VI project this year would indicate that the largest 
percentage of special teachers would like instructional help in the 
following areas? 

a. Rated Assessment Poms 

b. Techniques for utilizing work samples 

c . Slingerland Inventory 
d* Self -Concept Inventory 

e. Materials from resource center 

* 

Future work with the teachers in the current sample could focus 
in on these specific interventions* The result would be time more 
efficiently spent and higher percentages of teachers would rate the 
service as helping them to reach skill mastery in a new intervention, 
they find relevant to their classroom, 
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2.3 Mobilize other school staff in planning and implementing a" 

coordinated instructional program for pupils served by various 
teachers. 

Although a single interview schedule (Form Q) was intended for 
use in evaluating this objective, data pertinent to the programatio 
goal of shared responsibility for LD children among a variety of staff 
types is available through forms N, 0* and S, as well* In fact, this 
objeotive receives coverage in section 2*1 and 4*1 of this report | and, 
consequently, the reader is referred to those sections for additional 
findings , 

It was our observation that the concept and implementation of 
shared responsibility for the instruction of disabled and handicapped 
pupils through the use of special and regular teachers, counselors, 
social workers, and school psychologists, received some attention by 
the project staff. However, because of the relatively few psycholo- 
gists, counselors, and social workers who were affiliated with the 
project, we cannot state that a major effort in this direction was 
made. There was, of course, a great deal of evidence of cooperation 
between special and regular teachers, But, for the most part, any 
further involvement of other staff types was not achieved* Perhaps 
it is not wise to attempt a total coordination of all relevant staff 
until smooth procedures can be worked out between special and regular 
teachers. On the other hand, until psychologists and counselors modify 
their views concerning shared responsibility and mainstreaming of 
special students f changes in the instructional programs for these 
children will not proceed with great dispatch* 
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OBJECTIVE TmEB 

Development of regular teachers 1 skills in identification assessment, 
and instruction of pupils with learning disabilities, 

3*1 Identify early Indications of learning difficulties, 

3*2 Use diagnostic information in planning an individual student 
program, 

3*3 Select, and with monitored practice, administer informal 
assessment measures with due regard to each pupil's 
cultural and linguistic experiences* 

There separate devices were utilized as post-intervention 
measures of these sub-objectives, These forms are described in the 
Appendix (see forms M, N, and 0), In the following section the data 
from each of the forms is presented separately, A summary section, 
highlighting the major overall findings, follows, this discussion. 

The data from the Competency Rating of Regular Teachers are 
presented in Tables R3,la and W3*lb, This form was completed by the 
project staff as an evaluation for each of the regular teachers who 
had a significant amount of contact- with project personnel, Each 
item on the instrument covers a specific behavioral competency in 
pupil assessment, pupil instruction, and behavior management. The 
form is divided into two sections. The first sections cover specific 
competencies in all the previously mentioned areas, The second sec- 
tion focuses an the regular teacher's competency in formal and informal 
assessment for ten separate areas, 

Items 2*17 (Section One) were rated on separate three-point 
scales, unique for each item, In general a 1-rating indicated the 

i 

teacher did not apply or did not taow about the competency area, a 2* 
rating indicated the teacher had toiowledge of and used the competency 
skill to a limited degree, and a grating indicated the teacher was 
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Insert Table 10, la. 

Competency Rating... of. Regular Teaohers 

Inspection of Table M5*la indicates that the project staff a* 
average rating of the regular teaohers for section one competencies 
were only moderately high, In 15 out of 17 items the ratings fell be- 
tween limited skill and a moderate degree of skill. Only two items s 
those dealing with the application of reinforcement programs for aca- 
demic and social behavior had mean ratings below the limited skill level* 
The regular teaohers V mean ratings on those items dealing with a sharing 
of the responsibility and locating resources for instruction of the 
learning disabled child were all close to a maximal level. The varia- 
bility in ratings was moderately high, This provides evidence that the 
ratings were not uniform across the regular teachers * group (e,g,, some 
had high ratings and others had low ratings), 

Suninary 

The data from this table show there is still a need for more train- 
ing in the assessment, instruction, and reinforcement areas for the 
regular class teacher. This is especially true in the area of contingency 
management for both academic and social areas. The utilization of behavioral 
objectives was also close to the limited skill level as well, and should 
require further training* In no case did the regular teachers competency 
levels equal that of the special teachers* It is probably unrealistic to 
expect no differences between a group untrained in special education and 
a group previously trained on such a competency scale. However, minimal 
levels of competency should be attained by the regular teachers in all 
areas if mainstreaming is to become effective. At present what these 
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Table H3*la 

Hems and Standard Deviations for Competency Ratings 

of Hegulir Teachers by Project Staff 

, - Post Rating 

Competeney N Meg 3D 

L Use of diagnostic teste results to 

generate individual pupil prograis 18 2,2? ,57 

2, Use of behavioral objectives for each 

lent 21, 2.04 M 



3. Individualization of pupil objectives in 

terms of pupils strengths and weaknesses 21 2,23 .53 

I, Monitoring of pupil propss 19 2,26 $ 

v ! 5» Modification of instructional objectives 

| . based upon pupil propels 19 2,31 ,58 

l'_ no . ' ;: 
j V w 6, Uses a wide variety of instructional 

approaches for the individual student 20 2,20 a 6l 

7* Uses a wide variety of instructional 

5;'- approaches for pups of itudents 21 2,28 ,71 

8, Utilization of individual reinforeifflent 

propans for social behavior problems 20 1,80 »8) 

«9. Utilization of Individual riinforcOTent 

prop^ for academe problem 20 1.6o ,75 

10* Involvsient of tni student in planning 

Mr, own program 19 . 2,15 ,76 

feri.jjji 11* Utilization of other personnel in 

+■}.?**?'■■■■ pianning and instruction for students 20 2,55 



...... .v.," .' , ■. . ... i... ;■:<!::.- :■ ■ ,v. :. ' v; :,. , ■■ 

:• .-. • ' ' . • . ■ ./> ■>. >.. !:,"'-. ' :■■:'>; " ■■■>•'■> ./ v: :V:*' 

' ; ; Poet Rating : : 

Capetency N Mean , 3D 

12, Exhibit confidence in sharing itas 
with other staff members pupils work 

Jdtt 20 2,50 ,60 

13i Responsiveness to new Ideas 21 2,|6 ,4) 

l^i Identification of learning modalities 18 2,22 , ,8o 

15, Ability to locate and utilize raioure§ 

material appropriate to oliss 22 2*59 ,59 

16, Ability to locate and utilise resourei 

personnel appropriate to class 22 2,68 ,kj 
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minimal levels are has not been determined. Research that will identify 
competency levels in all areas covered by Form M would help to define 
goals for future training of the regular teacher in special education 
skill areas* 

Insert Table 10, lb 
Table M3*lb presents the ratings of regular teachers by the 
project staff on specific competencies in formal and informal assessment* 
The mean ratings on the formal assessment instruments that deal with 
basic abilities (i.e., perception, memory, cognition) were low in 7 of 
10 areas. Only those ratings of formal academic assessment devices 
(for reading, math, and spelling) were at a level that indicated the 
teacher could utilize them with a basic level of competency, The 
ratings for the informal devices were consistently higher. In 9 of 10 
[areas the regular teachers were rated at a basic competency level or 
above. However, the regular teacher would be limited to the applica- 
tion of only one assessment device with only a basic degree of com* 
patency in all the non-academic informal assessment areas. Again the 
regular teacher's skill in informal assessment of academic skills was 
approaching a high degree of skill and taiowledge, ■■ -. ■ 

Summary 

• In relation to the objectives of the project the regular 
teachers' can administer at least one Informal assessment device with 
at least a basic level of competence for 7 of 8 basic ability areas 
(i©e* f perception, memory* cognition). Their ratings for academic 
informal assessment instruments were higher and approached the top 
competency level. The standard deviation of these ratings indicates 
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TablrM^lb; 



Mems and Standard Deviations 'for Goffipftinov Rating of 
Assessment Skill! of Regular Tiaehars by Project Stiff 



Instrument 'Type 
Porwl Inform al 
Assessment Area N Mian SD N Mean SD 





DaUaII-J AVI 

BiMVlQr 




i ^ % n 1 n^ 


10 
±7* 




7 P ?fi OR 


Q ^ n B6 




\lA fills! 

visual rireip^iyn 


7 P P?l 


q ^0 86 




1*1Q yQF L/iv iiopoiiiiL 


7 ? U 1 fifi 


Q Vll 4 Q2 


3P 


Unpap 


in ? fin IT! 




23, 


Miiory 


8 2,3? 1,18 


, 9 2,88 .92 


2k, 


Cognitive 


12 2,83 1,19 


U 3,21 1,05 


1% 


Reading 


18 J.M ,98 


21 3.57 .7* 


26. 


Hath 


17 3.I1 1.00 


19 3.57 .76 


27. 


Spelling 


18 Ji« .98 


21 3.57 ,7* 



RATING W\ 

1 • Doesn't taow of any informal or formal methods in this area, 

2 - Knows of a single informal or formal method but does not utilize, 

3 - Knows of a single informal or formal method and uses with basic competency, 
■ toows of a variety 'of methods and uses one or more with high profieienoy. 



that there^was a large amount of within group variability. Therefore, 
some teachers still need a great deal of training while ethers are 
probably competent. The regular teachers 1 skills in formal assessment 
devices were low in all the basic skill areas. More training would 
be needed if the regular teachers are to be expected to administer 
formal assessment devices in any of the basic skill areas* As formal 
assessment devices were not specified project objectives this may be 
an unrealistic area to expect the regular teachers' to become skilled 
in* 

Self-Ratings of Competency 
The regular teachers completed forms N and 0 at the end of their 
year's contact with the Title VI project personnel* The content and 
construction of these forms is described in the Appendix. Both of 
these instruments were designed to serve as self assessment devices. 
The ratings on these forms correspond with the ratings given by the 
project staff on Form M (Competency Rating of Special or Regular 
Teachers)* As similar areas are covered by these forms the corres- 
pondence of self-ratings with outside ratings can be determined. 
In the following discussion the data for each of the forms (N and f 0) 
are presented separately* A suncmry section presenting the corres* 
pondence between forms M. N* and 0 follows this presentation* 

Trainee 1 s Self-Rating of Competency (N) 
Insert Table NJ.l 
The mean ratings for the regular teachers were between some skill 
and a moderate skill for all of the items* There were no items on 
which the teachers pereeived themselves as having a strong degree of 
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NVi, Means, and Standard Deviations for the Regular Teach 
Self-Rating of Competency 



'■■Iter N M§an 

1, Determining Learning Strengths and 
Weaknesses ISirQugh Formal and 

Inforaal Assessments kj ),1) 

2, Identifying Learning Modalities for 

Each Student kl 2,?3 

3, Developing Realistic Academic 

Behavioral Objectives ^3 2.9? 

I, Relating Student Instruction 

Propais to Aaaessoant Intonation ^3 2.88 

5« Utilizing Effective Techniques for 

Behavior Management 4) 2,6? 

6, Keeping Wack of Student Progress k) 3.1} 

?, Locating and Utilizing Resource 

Personnel Appropriate to Your Need }M 

8i keating and Utilizing Materials u 

Appreciate to Your Need 4) )M 

9, Structuring the Classroom Environ- 1 
Bent to Facilitate the Use of 
Resource Materials in the Indivi- 
dualization of Instruction I) 2,6? 



10, Developing tin "Sharing of 
Responsibility with Other School 
Paraennil in Masting the Needs of 
Learning Disability Students 

RATIO KESft 

1 - very little skill 

2 - some still 

3 - moderate skill 
k - strong skill 



^0 
GO 
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skill* The three highest scores, all at or slightly above the moderate 
skill level, were in determining learning strengths and weataesses, 
keeping track of student progress f and locating and utilising resource 
materials appropriate to your needs m The lowest skill areas, rated 
between some and a moderate degree of skill, were in utilizing effective 
techniques for behavior management, identifying learning modalities, 
structuring the learning environment to facilitate use of resource 
materials, and developing a sharing of responsibilities to meet the 
needs of learning disability students. The standard deviations for 
the items were all three-fourths of a point or above on a four-point 
scale* This indicates the teachers* ratings were spread out across 
the scale* Therefore, some teachers rated themselves well above the 
mean rating and others rated themselves considrably below the mean 
rating, 

Trainee's Self-Rating of Competency Change (0) 
Insert Table 03*1 
All of the mean ratings on the self-rating of competency change 
scale were at or close to the "some change" level* There were no 
ratings significantly above or below that level* The standard devia- 
tions of these ratings were all quite high, ranging from ,86 to 1*01 
on the four-point scale. Again the teachers 1 ratings were spread 
across the scale, but in this ease they ran very little change to 
moderate change* These ratings indicate the regular teacher f s per* 
ceived the project training experience as being only minimally help- 
ful in upgrading their skills to work with learning disabled students, 
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. Table 03.1 

N's» MiiMj and Standard Deviations for the Regular Teach! 
Self-Bating of Ooipetiney Changf 

Its I M 

1, Detsriining Leiraing Strengths and 
Weataiasts, Through Fozial and 

InforM AsseisMnti ^2 1*9? 

2, Identlf^ai Earning Modilitiei for 

Each Student ft 2*07 

3, Developing Realistic Academic 

Bihavioril Objectives ^2 1.97 

k t Relating. Student Instructional frogrinis 

to Assesnent Inforaatlsn ^2 2,07 

5, Utiliiini Effective Tsetoiquia for 

Behavior Managiiint 1*95 

6, Keiping Trick of Student Progress 2,l6 

7, Looating and Utilizing Resource Parsonnil 

Appropriate to Your Need M 2,17 

8, Locating and Utilizing Materials 

Appropriate to Your Need fa 2,29 

9, Structuring the Classroom Environment 
to Paeilitati the Use of Resource 
Materials in the Individualization of 

Instruction *1 2,29 



&1 



Summary 

The data from forms M« N. and 0 Indicated there are two major 
areas of expertise that the regular teachers have need for further 
training and help. The first area is that of behavior management 
techniques and the utilization of reinforcements for academic- social 
behavior change programs, Both the self*ratings and the outside 
ratings were lower for these skills than for the other areas overall. 
The regular teachers 1 also felt a need for more competence in assess* 
ment of learning modalities, and the outside ratings indicate they 
have little competence in the application of formal assessment devices 
for these areas. It is questionable how much we can expect the 
regular classroom teacher to know in the formal assessment area. 
Usually this area is the realm of the school psychologist and requires 
at least two years of graduate training in various assessment skills 
and procedures, Therefore, formal assessment techniques are probably 
beyond the skill and competence of the regular teacher without a great 
deal of training, more than any one year program can provide, However, 
it is important that the regular teacher understand the results of 
these assessments for instructional planning. Training should focus on 
application of results from such formal assessments rather than admin- 
istration - independent of these instruments, 

3.4 Adjust the classroom environment to assist learning dis- 
ability students by adapting source, time ejtpeotations, 
quantity of assignments, type of instructional approach 
used, and amount and type of teacher f s reinforcement, 

3.5 Create and utilize a wider variety of instructional 
options 9 
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Checklist of Intervention for Regular Teachers 



This instrument was administered post- intervention to all regular 
teachers who had a significant amount of contact with the project* Each 
item on the checklist represented a specific approach to diagnosis, in* 
structional planning, teaching technique* instructional material, behavior 
management technique f and a motivational approach* The teachers rated 
each item on the form utilising the following scales 

1, That you used item prior to Title VT intervention* 

2. That the item is not appropriate to your teaching 
situation* 

j5* That you feel you need more help for competency 
in use* 

4* That your understanding of item was furthered by 
Title VI and you will use* 

5« That you have mastered the item and are now using. 

These items represent intervention approaches that can be utilized 
by the classroom teacher to create an instructional program that is 
better tailored and more responsive to the needs of learning dis- 
ability students. 

The responses to each item were tallied and the percentages of 
response in each category were calculated. Table R3*5 presents the 
item descriptors, sample sizes, rating categories* and the percentages 
of ratings by category* The data in Table R]5*5 were analyzed to 
determine the modal response percentage for each item* When there 
were ties in the data no modal response was computed for the item* 
The following discussion reports the results of this analysis. 
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Insert Table R3*5 

The regular teachers rated nine of the items as being ones they 
were previously f Miliar with based on their modal ratings, These 
items included behavior management techniques, behavior contracts, 
teacher made games, individualized instruction, learning centers, etc* 
It is not surprising that regular teachers had heard about or prac- 
ticed these techniques as they have become part of regular education* 
Their modal ratings indioated the following seven items were relevant 
but that they needed more training to become competent in their use 
of these interventions! 

a. Academic Contracts 

b, Writing academic and behavior objectives* 
c* Anabell Markoff Inventory 

d* Hated Assessment Form 

e. Language Masters 

f s Oilmare Oral Reading Test 

g* Slingerland Inventory 
At least 4 of these interventions have an origin in special education 
and therefore were less familiar to the regular teachers. The regular 
teachers 1 modal rating w&s Category 4 (understanding of the item was 
furthered by Title VI and you will use) for "materials from the 
resource center * 11 The help they received in terms of extra and spec* 
ialized materials from the Title VI-0 project staff was therefore an 
important aspect of the program for regular teachers, 
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fable R3.5 

Piraentipi of Ratings for Intervention Procedures by 
•Regular Teachers 



2, Academic Contracts 
] ( Behavior Contracts * 



10. Writing Aca^eudc and Behavioral 
Objectives 

11, Rated Assesment Pons 



Rating * tejnt 

Intarvsntion N I 2 3 ^ 

L Behavior Management Deobnips * 39 ^ 10 26 13 



37 2? 19 27 21 
36 17 19 36 28 



I, Laarning Centers 39 36 8 31 23 

5, Multi-Level Lewn^i Materials 40 58 3 13 25 

6, Teaeher Mads Games * ^1 51 10 2 ^ 

7, Jflaterials ftWB the Rewwrce Center to 30 8 10 ^5 

8, Individualized Instruction * H $ 5 i0 22 
9 # Informal Diagnosis of Lsiming Styles to ^ 5 2} 23 



37 27 U 51 11 

25 8 2^ 56 12 



12, Regular Stiff as 1 Resourci * 35 5? U H 

13, Self-Concept Inventory ' 33 f 5 $ 15 
\K Techniques for Utilizing Work Samples 26 23 8 $ 12 
15, Behavior Observation Techniques 3^ ^2 3 21 15 



Intervention 

16, toabell Markoff Inventory 

I?* Lanpige Masters 

18, Wide Range Adhiivimint Test 

19, Gitee Oral Reading felt 

20, Slingerland 

21 1 Developmental learning Masters 



Rating - Percent 

N 1 2 J k 

29 21 28 38 10 

29 21 28 38 10 

Jl 3 15 29 12 

26 4 4a 5^ 0 

26 8 23 ^ 15 

53 33 3 27 33 



m Mm CATEGORY? 

1 - That you used item prior to Title VI intervention. 

2 - That the item ii not appropriate to your teaching situation, 

3 - 'Bat you fill you need more help for eonpetenoy in use, 

k - That your understanding of item wis furthered ty Title VI and you will use. 
5 - That you have mastered the item and are now using i 



Senary 

The regular teachers were aware of almost half of the interven- 
tions presented by the Title VT project prior to this year. They did 
find seven new areas which relate to the instruction of educationally 
handicapped children. Instead of becoming competent the teachers were 
made aware of their importance and are interested in more training to b 
able to use them. They also became aware of and utilized the resource 
materials provided by the project staff* This is an important step as 
it^ approximates the type of behavior teachers will have to emit when 



mainstreaming becomes mandated, Fre-assessment of ijtgular teachers is 
an important step prior to inservioe or pre^servioe training as this 
data has indicated. If the project staff could focus on the seven 
areas pinpointed by a j~rating above a more effective and efficient 
program would result. 
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OBJECTIVE POUR 

Implementation of alternative patterns of service by support personnel 
(principals | social workers, school psychologists , eta*) 

4.1 Allocating space, funds , materials, and personnel support for 
the daily operation of an EH program within a school building. 

In order to evaluate the fourth program objective, the a valuator a 
conducted interviews of a representative sample of school administrators f 
special and regular teachers, and support personnel in the eleven San 
Francisco schools served by the project, 

The sample for these interviews was selected as follows i the 
project staff was informed of the need for and nature of the interviews. 
They were asked to provide a list of 22 individuals from the eleven 
schools such that an overall balance would be reached among administrators 
teachers f and support personnel. Originally, the intent was to develop 
a random sample derived from a list of all school personnel who had 
made contact with the project during the past year. However, when this 
strategy was employed, it became readily apparent to the project staff 
and reasonably so, that not all of these individuals had had similar 
levels of contact with the project p and thus, had highly varying degrees 
of knowledge about the project. Therefore, a decision was made to employ 
the criterion of familiarity with the project as an important dimension 
in the sample selection process. The result of this procedure was a 
list of 22 school personnel, two from each of eleven schools, selected 
by the project staff on the basis of their contact with and familiarity 
about the project activities. The sample was composed of 10 principals 
and assistant principals f 5 EH or LDG teachers, 5 regular teachers f 
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1 counselor, and 1 social worker. 

Although the interviews were based upon a structured interview 
schedule (see Appendix), the nature of some of the questions was 
sufficiently open-ended to elicit a broad range of responses from the 
interviewees. The intent of the evaluators was to gain specific informa- 
tion concerning the kind and quality of service rendered as well as more 
general information pertaining to the perceptions of school personnel 
about the overall goals of the project and possible reasons underlying 
its strengths .and weaknesses. ~ ' * 

All interviewees were asked the same set of questions in the same 

order, except that school administrators were asked an additional question 

concerninTthe allooation of additional space or funding as a result of 

the project (see Objective 4,1). The interview results were as follows: 

Question li What is your perception of the role of the 
Title VT-0 Project as it relates to your 
school? 

The intent of this question was to determine to what extent the 
project staff had articulated its goals and objectives to school per- 
sonnel and to determine if perceptions varied across schools and types of 
personnel. Due to the open-endedness of the item, content analysis was 
employed in an effort to categorize the variety of responses received. 
In our judgment, the responses could be summariaed under five major areas i 
(1) classroom management, (2) instructional resources, (3) diagnosis and 
.prescription, (4) inservice training, and (5) mainstreaming procedures. 

Table 4,1a ghows the results for question 1, Across the top of the 
table are listed the various types of school personnel interviewed. The 
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Table 4,1a V • . ; : 

Classification of IntirviiWiia ' Rieponiis to tiie ^sstiom "What is your 
perception of the roll of tht Title VI4 Project as it relates to your school?" 

Peraomielte 

Adtifli EH Teacher Reg, Teacher Support TOTAL 
(10) (5) (5) (2) 



I, Clissrooi Management 7 5 1 0 11 

II, Instruetioail 

• Resources 1 k 1 Q 6 

III, Diagnosis and 



IV, ' Injendce Gaining 1 0 I 1 \ 

V, Milhstriiidm 

Procedures 3 I 0 15 

VI, Don't to ' 5 1 0 1 5 



TOIL 16 10 5 3 J* 
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f iv^ pateger ie s of responses are shown on the left* Response frequencies 
are summed across oolurois and rows to indicate differences among cate- 
gories* It is important to note that a single interviewee's verbal 
response to this question could have dwelt on only one of the five 
categories f or j potentially, could have contained elements of all five 
categories. For this reason* the sums of rows and columns do not equal 
the number of interviewees 1 , 

As is apparent from Table 4* la the administrators generated the 
largest number of responses in different categories. However, when eon- 
trolling for group sizes , it would appear that EH teachers f on the 
average were the most prolific in their responses, Their average of 
two response categories per person was the highest in all personnel 
categories* Thus it would appear that EH teachers were somewhat 
better informed about the goals of the project than, other school 
workers* As a group they were followed by administrators* regular 
teachers f and support personnel. These data coincide with the subjective 
feelings of the, interviewers, It should be added, though* that there 
was considerable individual variation within personnel categories and 
across schools* As can be seen from Table 4.1a t a total of 5 individuals 
admitted to such little participation with the project that they could not 
state its goals* There were other individuals in each group who were 
extremely well informed and who had participated at a high level. 

Table 4* la also indicates that different personnel had somewhat 
different views as to the major goals of the project* While adminis- 
trators tended to perceive classroom management as the most important 
goal! with mainstreaming of secondary importance; other school personnel 
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were more varied in their responses, EH Teachers considered instruc- 
tional resources as the primary goal followed closely by classroom 
management, and regular teachers emphasized inserviee training somewhat 
over other goals. It is interesting to compare these perceived goals 
with the data on actual help received, the next section of the inter- 
view, 

Question 2i What kinds of help did you (or your staff) receive 
during the past year from the Title VX-G Project? 

This question was posed initially as stated above so that re- 
pondents would not be constricted in the types of help they testified 
to* When the respondent concluded his initial statements the evaluator 
probed further to ascertain levels of help in specific areas which the 
respondent may have overlooked* 

The kinds of help received by school personnel were categorized 
into five general areas: 

1, Teacher Consultation: ongoing discussion with, 
teachers which provided guidance and feedback to 
them concerning their efforts toward remediating 
learning difficulties of children in their classrooms. 

2, Student Instruction; direct service to individuals or 
small groups of children in terms of diagnosis, 
prescription, instruction, and monitoring of 
progress , 

3- Classroom Management; working with the teacher to 
restructure the classroom environment and the 
instructional process to alleviate inappropriate 
student behaviors and to promote individualization 
of instruction, 

4, Curriculum; providing the teacher with new resource 
materials and instructional strategies which would 
aid their teaching of cognitive and affective skills. 
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5* Inservice Training % providing professional instruction 
for teachers designed to augment their theoretical and 
f practical Imowledge of special education. 

From Table 4,1b it can be seen that considerable variation existed 
between individual schools as well as between levels of schools on overall 
help received* There was also substantial variation between help cate- 
gories from school and even over all schools combined, 

In terras of help categories, teacher consultation was offered at 
a higher level across all schools than other types of help. Help with 
curriculum and inservice training followed closely behind, however, and 
probably represent no significant difference from teacher consultation 
help across all schools. Only one of the eleven schools f Stevenson, 
received no help in these three categories* All other schools received 
some or considerable help with regard to teacher consultation, curri- 
culum, and inservice training* 

Help with student instruction varied considerably across schools, 
At three schools it received primary emphasis, and at three others it 
received little or no emphasis. Help in the classroom management 
category was emphasized considerably less than other forms of support in 
all schools, receiving little or no coverage in 5 schools, and moderate 
coverage in the other 6 schools. 

In terms of school levels, there were also differences between 
the overall amounts of help received and between levels of help in 
different categories. For instance, teacher consultation was provided 
at very high levels in most intermediate and secondary schools but to 
a much lower degree at primary elementary schools. Almost the same 
phenomenon oecured with category (2), student* instruction, With 
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Classification of Interviewees' Htsponses to the bastion 
"lat kinds of help did you (or your ataff ) receive during 
the past par from the title ftG Project?" 

Help Categories 







in 


(2) 


(3) 


M 


(5) 


Mean 


Primary (K-J) 
Hearst 




1 


0 


1 


i 


2 


1.0 


Noriega 




' I 


0 


0 


i 


I 


o,B 


Ian Mipel , 




1 


1 


1 


l 


1 


1.0 


Stevenson 




0: 


0 


1 


2 


0 


0.6 


mean 




0.75' 


0,25 


0.75 


1.25 1 


-.25 


0,85 


Interffiidiate (W 


) 














—•Edison—- - 




1 


1- 


- 0 


- 2- 


4 


1,0 


Lavrton 




2 


2 


i 


1 


2 


ii 


Mark Twain 




2 


.1 


0 


1 


2 


1,2 


Scott 




2 


2 


1 


1 


1 


l.k 


lean , 




1.75 


1.50 


0,50 


1.25 1 


,.50 


1,30 


Secondary (7-12) 
Aptos 




2 


1 


1 


1 


1 


1,2 


McAtier 




2 


2 


0 


2 


1 


M 


Portola 




1 


1 


0 


1 


1 


0,8 


mean 




1,6? 


1.33 


0.33 


1.33 1 


,00 




Mi). Categories: 


i 

(1) Teacher Consultation 




merle 


Codi: 0 - 


little or 


no he] 


.p 


(2) Student Instruction 






1 1 


some help 







(3) Classroom Manapient 

[k) Curriculuffl 

(5) Inserviee Training 



2 « ooneiderable help 



respect to help with classroom management, the reverse was true? 

though this farm of help received relatively lower levels of assistance 

across all schools. The two types of project assistance which appeared 

to occur with greatest regularity across all school levels were those 

in the curriculum and inservice training areas* Overall, it was our 

impression that intermediate schools received the most help followed 

by secondary schools and then primary schools* 

Question 3% (For administrators only) To the best of your 

knowledge have added funds or space been allocated 
_ to your EH or LDG program since involvement with 
Title VI-G? 

This question was posed to each of the 10 administrators in the 

interview sample. Their responses were in total agreement » With the 

exception of indirect funding to provide release time for teachers to 

attend project workshops, there were no additional allocations of funds 

or space for the EH or LDG programs in their schools* 

Question 4; Please give me your opinion of the effectiveness 
of the Title VT-G Project during the past year 
by indicating some of its strengths and wealmesses. 

Because the responses to this question were so diverse in 

nature, and in order not to obscure the oonoreteness and spontaneity of 

reactions through our subjective interpretations! we have decided to 

present the verbatim responses given by the interviewees to this 

question* 

Strengths 

— dedicated staff | willing to go beyond the call of duty* 

— no ego trips ; they put the kids first 

flexibility willing to try to work it out in best possible way 

— ' honesty; no bullshit; no blaming 

important tools have been made_ available which will enable us to 

carry on 

— somebody cares about teachers 
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stimulating new ideas for teachers 

good inserviee workshops - stimulated inte rest in new ideas 
direst service to teachers and children 

ongoing consultation very valuable! good to have someone to talk 
to who cares 
- access to new materials 
helped in reducing isolation of teachers and served to stimulate 
the forming of groups of teachers with similar interests 
reassures teacher and builds self confidence 
release time very valuable to get a glimpse of other programs 
and technique^ 

they went beyond expectations * reinforced what we were trying to do 
added to the morale of the school 

very positive , supportive! helped with individualizing instruc- 
tion; offered valuable workshops 

provided very valuable feedback for what I was doing 

terrific, really enjoyed having them; good impact on the school; 

dynamic, poised, capable, no friction 

breath of fresh air from the outside - extremely beneifeial 

provided excellent curriculum materials 

extremely helpful in consulting role; very reliable 

very efficient, honest, reliable, good organizational ability 

the consultants were really teachers 

Weaknesses 

not enough time to go into depth 

lack of continuity; too temporary 

more time needed - late entry into school 

goals weren f t spelled out; structure of the project wasn't clear 
no bridging between years of the project * too many personnel 
changes » poor coordination 

things not focused well enough; tried to do more than humanly 
possible 

disorganization; not enough continuity or follow- through 
good ideas, but execution not so hot 
disappointed in lack of interns 

administratively not handled as well as it could have been 

models are not realistic at the grass roots level 

was not clear as to who could use project resources 

more practical work, less theory; not so much lecturing in 

workshops - have more how-to kinds of demonstrations 

didn f t get the same mileage as last year 

no time for consultation except over a cup of coffee 

in order to do precision teaching, need more time for consultation 

need regular visits one day a week more feedback on what is 

done with. children 

program should be more people-oriented and less materials 
oriented 

follow up inserviee training', rather than a one-shot deal 
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— mixed up about what Wtle VI wab supposed to do - a brochure 
would help * who ^ what, where, when,, ©te*. 

~ no contact with -project 

— lack of program philosophy 

\ -va ; Summary v.,". • " <\:;'/;', 

It was our impression that the positive attributes of the 
project far outweighted its negative aspects. But, of course, there 
is always room for improvement* It was readily apparent that the 
staff did not do a consistently good job of articulating its purpose 
and modus operandi across all the schools* School personnel were not 
always clear about the philosophy and overall goals of the project. 

In terms of the kinds of help provided by the project staff , 
there appeared to be an expressed need at several school sites for 
more ongoing supervision, teaching, and training* This situation is 
almost certainly a reflection of the project 1 s attempt to serve a 
large number of schools , . rather than to concentrate its help to a 
smaller number of schools on a more intensive basis, 

In conclusion, it was certainly apparent that much of what 
the project staff had to offer was well accepted, but that their 
ability to bring teachers to optimal levels of competency and to re- 
shape the attitudes of administrators, teachers, and support personnel 
toward a feeling of shared responsibility for disabled learners 
suffered somewhat due to a number of factors including late entry into 
the schools, not enough follow through activities with teachers and 
children, and limited coordination of activities among various members 
of e^eh school site, 
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OBJECTIVE FIVE 

Working with teacher-training institutions to provide opportunities 
(pre-servioe and in-service) to have monitored practicum experiences 
with students, parents, and school staff a in pupil assessment f in- 
struction and consultation. 

5.1 To what extent (frequency, duration, and quality) was the 
project able to provide practicum experiences with pupils, 
parents, and school staffs in pupil assessment, instruction 
i and consultation? 

On the basis of a strong and rather successful effort by pro- 
ject staff during the first two years to establish relationships with 
local colleges and universities to provide internship experiences for 
teacher trainees, sua instrument was constructed to assess the quality 
of this experience, Form T, College/University Student- in-Training 
Activities Questionnaire* In addition, it was our intention that 
s tuden t- in- training would also respond to forms N and 0, the self- 
rating forms of competency and competency change. 

Due to the heavy emphasis on research and evaluation during 
the third year of the project, and the concomitant requirement that 
project staff participate quite actively in that effort % a decision 
was made early in the year to deemphasiie pre-servioe training of 
teachers. Thus, there were only two teacher-trainees who partici- 
pated with the project during the past year, (there were also two 
research*and evaluation trainees, but their goals and activities were 
quite different from those intended for teacher trainees) . 

Questionnaires were administered to all trainees at the end of 
the academic year. However, because of the extremely low number of 
individuals responding, and because their reasons for project affilia- 
tion were considerably different, we cannot reasonable report the 
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questionnaire findings, Suffice it to say that these four individuals 
indicated that they benefited from their contact with the project and 
were generally satisfied with the supervision they received. 

In terms of inservice training of teachers there were extensive 
workshops provided by the project. However, in the main, these were 
not provided on an institutional credit basis. Such an arrangement 
might have been worthwhile for achieving a longer-term program of 
instruction for district teachers. 
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SUMMARY 

Academic Achievement: 

The standardized measures of academic achievement in reading, 
math, and spelling showed significant increases for J or 9 variables 
assessed. The largest degree of change on the instruments was observed 
in the primary and intermediate groups. These groups were also involved 
with the project for a significantly longer period of time than the 
secondary students. Specific measures of oral reading subskills in- 
creased in 15 of the 27 areas measured, The intermediate and secondary 
students had the greatest improvement in these measures. The project 
students significantly increased their math computational skills for 
8 of 60 areas assessed across the groups* The project intervention 
procedures had little effect on the teachers* perceptions of their 
students academic levels, The Work Sample data was also not reflective 
of changes as it was too unstructured to analyze. The major overall 
area of change from the data was in reading at all levels, However, in 
only a very few instances did the average scores obtained by the project 
students indicate a proficiency level had been achieved in any of the 
academic areas. Further remediation is necessary, in almost all areas, 
for all students in the basic academic skills. Since the project staffs' 
interventions were of a short duration overall, this is not a surprising 
finding, It does, however, indicate that it takes longer than three 
month period to produce significant differences in pupil achievement 
overall. 
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Re^ulaiL Teacher '3 1 

The regular teachers 1 self-and outside ratings showed some to 
moderate improvement in skill levels* The regular teachers perceived 
that they did change in proficiencies but not to the degree necessary 
for full implementation of the skills. The competency ratings in- 
dicated the following areas need further training; application of 
behavior modification to academic behavior, and assessment of learning 
modalities* The regular teachers were interested in receiving training 
in a wide variety of assessment areas as well, This mismatch between 
the competency ratings and the needs perceived by the regular teachers 
poses an interesting problem, The areas they wish to receive training 
in are different from the ones that are their lowest areas of competence. 
Possibly a combination of high interest and low oompetancy areas 
should be tried in designing further training. It is also obvious that 
regular teachers will need further training to operate in a mainstream- 
ing program effectively* In order to bring them to such levels it will 
take additional intensive training beyond what has already been provided 
by the project* 
Special Teachers ; 

The self- and outside ratings of competency for the special 
teachers ranged from a moderate to a high level of skill overall. The 
special teachers rated their change in skill as being from a small to 
a moderate increment for the past year. The major area of improvement 
was in the provision of materials to meet the learning needs of their 
students* There were differences in the areas rated as needing fur- 
ther training between the project staff and the special teachers* 
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The pro jest staff indicated that the special teachers needed further 
help in writing behavioral objectives and the application of behavior 
modification techniques* The special teachers indicated they wanted 
further training in the assessment instruments that had been introduced 
by the project staff this past year. These differences in ratings 
indicated that special needs assessment should be implemented prior to 
any in-service training for special teachers. The needs assessment can 
serve to pinpoint areas for future training and focus the project 
staffs 1 activities more effectively. 
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Index - Appendices A-T 

Instruments developed by Title VI-G Project Staff to measure changes in 
pupil behaviors self-concept, and academic performances: 

Pages 

a Development and Use of Instruments 1 

§ Chart of Time Spent on Instrument Development 11 

o Student Referral Form (A) A-l to A-5 

t ^Pupil Observation Form (AF) (B) B-l to B-2 

s Pupil Observation Form (IF) (C) C-l to C-2 

$ Contract Count (D) D-l to D-4 

• Inferred Pupil Self-Concept Rating by 

Teacher ^ (E) E=l to E-2 

§ Pupil Self-Concept Inventory (F) F-l to F-8 

§ Teacher Rating of Pupil Performance (G) G-l to G-2 

§ Work Samples (H) H-l to H-2 

e Wide Range Achievement Test (I) 1=1 to 1-4 

t Rated Assessment Reading (J) J-l to J-ll 

s Rated Assessment Math (K) K-l to K-21 

s Rated Assessment - Oral Reading Gilmore (L) L-l to L~4 

© Competency Rating of Special or 

Regular Teachers (M) M-l to M-7 

o Trainee's Self-Rating of Competency (N) N-l to N-2 

• Trainee's Self-Rating of Competency Change (0) 0-1 to 0=2 

t Intervention Check List for Special 

Teachers (P) P-l to P-3 

§ Schedule for Interviewing Special or 

Regular Teachers " (Q) Q-l to Q-2 

§ Intervention Check List for Regular 

Teachers (R) R-l to R=3 
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* Schedule for Interviewing Administrators (S) 

# College/University Student In Training 

Activities Questionnaire (T) 
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DEVBLQBCTr AND USE J3P _3M3TRtIMEWTS 



The instruments for measuring changes in pupil behavior, self- 
concept and academic performances were developed by the Title VT-G 
staff, Each instrument is included in the Appendix, together with an 
explanation of its use, 

The instruments were administered to target pupils as a pre- 
test and again as a post-test following an intervention by Title VT-G 
staff. The intervention periods and numbers of target pupils were 
as follows* 

Intervention Number of 

Grade Level Period Target Pupils 

K-5 138 Calendar Days 31 ' 

4-6 171 » »« 26 

7-12 74 " " 31 

The following chart indicates the time spent by Title VT-G staff 
in developing and implementing the assessment instruments for measur- 
ing pupil change * 

. The chart also reflects Title VT-G staff time spent in developing 
the forms used by the evaluation team to measure the effectiveness of 
the project. 
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DgfHDM MP USE QP MTOfflTS (A, B, 0. D, F, 5, J, K, M, N, 0, P t R, k S Appendix) 
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STUDENT OR CLASS REFERRAL FORM (A) 

The referring teacher filled out this form for all individuals or 
groups of students who were served by the project* The form was 
developed to describe the specific behaviors of concern for each re- 
ferred pupil (or group) and the degree of intensity of these behaviors. 
This form can be used on a pre-post or pre-during-post intervention 
basis to determine if the referring teacher perceives any changes have 
oceured in the behavior of targeted pupils. 

The first section of the form is Problem Behavior, It consists 
of l6 items describing socially inappropriate pupil behaviors, -Each 
item is rated on a four point scale ranging from 1-high frequency of 
occurrence to 4-never occur* The lower the score on this half, the 
more severe the pupil's behavior problems* The second section on this 
form is Work Related Behavior, It consists of 16 items describing 
pupil work habits and task completion related behaviors. Each item 
is rated on a four-point scale ranging from 1-high frequency of 
occurrence to 4-never occur* The lower the score on this half the 
more severe is the' problem* A number of the items on the referral 
form were selected from one developed by the OQRBAH project at the 
University of Oregon (1975) - 

An inter-rater reliability was derived on the form by measuring 
the agreement between special teachers and regular teachers ratings of 
the same child on the form, The mean correlation was ,6l between the 
two raters overall* In 19 out of 22 cases the agreement between the 
two raters was statistically significant. In comparison with other 
standardized inventories of pupil behavior this level of relationship 
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is a highly favorable one. However , we should point out that, although 
inter-rater reliability was high, there was a definite difference in the 
way the two groups of teachers used the four-point scales* On almost 
all items, the special teachers rated the children higher (more positively) 
On half of the items these differences were statistically significant* 
Another interesting phenomenon is that much greater agreement existed 
between special and regular teachers on Part I, Problem Behavior* than 
on Part II, Work-Related Behaviors* We suspect that this situation is 
due to a classroom environment effect since work-related behaviors are 
more situational-speeific than problem behaviors, However, further re- 
search is required to substantiate this* The important point here is 
that, in terms of future evaluative use' of this instrument* pupil ratings 
should be made by the same teacher (special or regular) for both pre-and 
post- intervention measures. Otherwise, if 'children were rated by 
regular teachers at the time of referral and by special teachers at the 
end of intervention i many spurious improvements might be noted which, of 
course, would not reflect the true situation. (Note: these results are 
based on a combined analysis of this instrument and Form 0, Teacher 
Rating of Pupil Academic Performance, which follows.) 

The form was utilized on a pre-post treatment basis on the project* 
The teachers rated all pupils on all behaviors covered by the form. 
Change scores were computed between the pre-and post- ratings , A corre- 
lated T-teat was used to test for the significance of a difference 
between the ratings, 
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STUDENT OR CLASS REFERRAL FORM 
Title of person completing form = __ Sfi _ w—- 

Date 

(PRE - POST - MHER) 
A. Student's name / or B. Classroom 

Birthdat e Grade S ubject 

Teacher -&te&Ba ____ &= _ = Person Servicing 

Dates - Pretest Interim Test ______ Post Test 



Scale-Prequenoy (Circle appropriate) 





i High 


. Medium 


Low 


Never 


PROBLEM BEHAVIOR 










1* Out of seat 


H 


M 


L 


N 


2, Yelling out 


H 


M 


L 


N 


5- Running around room 


H 


M 


L 


N 


h m Hitting and pushing 


H 


M 


L 


N 


5* Ignores teaoher'a 


H 


M 


L 


N 


directions 










6. Ignores other 


H 


M 


L 


N 


adult's directions 










7 . Complains 


H 


M 


L 


N . 


b , Fighting 


H 


M 


L 


N 


9. Stealing 


H 


M 


L 


N 
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A=3 



High Medium Low Never 



10. Destroys own 


H 


M 


L 


■i iji 

N 


property 
11* Destroys others 


H 


M 


L 


N 


property 
12. Talks back to 


H 


M 


L 


N 


teaeher 
*3" Lies 


H 


M 


L 


N 


l4# Excludes self from 


XI 

(1 


M 


L 


N 


activity in class 
15* Excludes self from 


ft 


M 


L 


N 


activity outside „ 
class 

16, Temper tantrums 


H 


M 


L 


N 


II, WORK RELATED STUDENT BEHAV] 


I0R 




1* Attends class H 


M L N 


2, Is able to work with 
classroom distractions 


H 


M 


L 


N 


5* Begins work 


H 


M 


L 


N 


4, Stays on task 


H 


M 


L 


N 


5. Completes class 


H 


M 


L 


N 


work 

6, Works independently 


H 


M 


L 


N 


7- Works as a member 


H 


M 


L 


N 


of a group 
8, Completes homework 


H 


M 


L 


N 


9* Attempts difficult 


H 


M 


L 


N 



work 
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High 


Medium 


Low 


Never 


10 * Works quietly 


H 


M 


L 


N 


— - • - = - - ■ - • • • - - ■ •• ■•■ 

11 • Takes pride in _ 


H 


M 


L 


N 


work 










12. Organizes 


H 


M 


L 


N 


material s/vork 










15* Follows 


H 


M 


L 


N 


directions 










- 

l4 s Helps other 


H 


M 


L 


N 


students 










15* Accepts correction 


H 


M 


L 


N 


of work 










16, Accepts transition | 


H 


M 


L 


N 



Periods 
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PUPIL OBSERVATION FORM (HIGH FREQUENCY BEHAVIOR) (B) 

This f onn is utilized when specific behavior change programs are - 
being planned or are in operation for an individual student or a group 
of students. The referring teacher utilizes this form to record fre- 
quency counts of specific problem behavior that have a ndnimum frequency 
of occurrence of at least once per obsecration period. The form con- 
sists of five columns of numbeB from 1*15, Each column represents one 
day of the school week from Monday through Friday. Every time the tar- 
get behavior occurs a mark is made through the number on the form, or a 
separate count can be obtained by utilising other procedures (i*e, f wrist 
counters, check card, etc.) and then transferred to the form. In this 
way a daily count of the total frequency can be obtained from the form 
and day-to-day changes in frequency can, be determined by inspection of 
the data recorded* Similar forms have been utilized in a number of 
behavior modification programs and are standard devices in the applica- 
tion-evaluation of such interventions. 

Frequency counts can be obtained on a pre-post or a pre-during- 
post (continuous) intervention basis. The counts can be analyzed by the 
use of a mid-median (Lindsley, 1968) or a median-slope analsys ( Whits ,1971) # 
Through the application of such statistical procedures the probability 
and significance of changes in behavior due to specific intervention 
programs can be derived. 
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CALIFORNIA TITLE VX-G PROJECT 
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Student 



PUPIL OBSERVATION FORM ^ HIGH FREQUENCY 
OF OCOURRMCE OF PROBLEM BEHAVIOR ~ 

. School 



Referred behavior 



Period 
Date 



Observer 



(TEACIffiR, AIDE, OTOER) 



(PRE - POST - OTHER) 



OBSERVATION TBEi 











15 


15 


15 


15 


14 


14 


14 


14 


15 


15 


13 


13 


12 


12 


12 


12 


11 


11 


11 


11 


10 


10 


10 


10 


9 


9 


~i 


9 


8 


8 


8 


8 


7 


7 


7 


7 


6 


6 


6 


6 


5 


5 


5 - 


5 


4 


4 


4 


4 


3 


3 


3 


3 


2 


2 


2 


2 


1 


1 


1 




1 



o 

M 

I 



8 S 



PQ 
o 



15 
14 

13 
12 
11 
10 

9 
8 

7 

6 

5 
4 

3 
2 
1 



Month : 



Mon. 



Tues, 



Wed, 



Thurs, 



Fri. 



* Circle the number of times the behavior occurred within the selected 
period , 
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PUPIL OBSERVATION FORM (LOW FBEQOEtJCr BEHAVIORS) (C) 

This form is applied when specific behavior change programs are 
being planned or are in operation* The referring teacher utilizes this 
form to record critical incident counts of specific problem behaviors 
that occur less than one time per-observation period for an individual 
student or for groups of students* The form is divided into two halfs, 
A.M. . and P.M*, and covers one school weeks The teacher records the 
time of day when the specific problem behavior occurs. Examples of 
low frequency problem behaviors include tantrums, physical fights, 
property destruction, etc. The form can therefore be applied to record 
both the time of occurrence and frequency count for any low frequency 
problem behavior* The data can be used to pinpoint if time of day is 
a variable that determines the occurrence of any behavior, and can 
therefore lead to some refined intervention programs. 

The frequency counts can be obtained on a pre^post or a 
pre-during-post (continuous) intervention basis. The counts can be 
analyzed through the application of a mid^median test (Lindsley, 1968), 
This statistical procedure can help to determine the significance of 
changes produced by any specific intervention programs for low fre- 
quency behaviors, 

1 
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PUPIL OBSERVATION FORM - LOW FREQUENCY 
OF OCCURRENCE -OF PRfyRTJTM BBiAVIOR 



Student 



School 



Referred behavior 
Date 



(PRE - POST - QTtSB) 



Observer 



(amcHER - aide - oram) 



• 






m 

Or 

1 






ffl 






© 












* 






* 

CM* 


....... 











Month i Mon. 



Tiles, 



Wed, 



Thurs, 



Fri. 



* Record the time the behavior occurred. 
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CONTRACT COUNT (D) 

The teacher uses this form to keep track of the number f goal, 
reward, and effectiveness of learning^behavior change contracts made 
with an individual pupil. The form is divided into four columns that 
allow for the description of each contract and the recording of all 
contracts on a cumulative basis, The first column records types of 
contract (verbal or written) , the second the behavioral requirements 
(aim), the third the reward (payoff), and the fourth the outcome (if 
goal was reached)* The form provides an ongoing record that allows 
the teacher to evluate contracts-mediated interventions with each 
pupil , 

The form can be analyzed for an individual pupil or for groups 
of pupils. The percentage of successful contracts overall and the out- 
comes of specif ie contracts by type can also be determined, For 
example, verbal contracts could be compared with written ones, free, 
time payoffs could be compared with tangible payoffs, and the effective- 
ness of contracts on specific tasks (reading vs, writing) could also 
be determined, The data could lead to more effective intervention 
planning for an individual child or for a whole classroom. Comparisons 
of this nature would be done by computing percentage of success in 
each category and then comparing those percentages. 

Each contract can be classified into nine (9) and possibly 
more categories. Within each category a number of subcategories might 
exist, (For example, Grade Level could be divided in 4-6, 7-*9$ 

and 10-12 subcategories). 

Following is a list of categories and within each category the 
nonlnclusive list of subcategories. 
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CATEGORY I: 



Area of Improvement Desired 



1* Math 

2 • Reading 

3. Spelling 

4 . Behavior 

5. Self-Concept 

6. 

7* ZZZIZZI 
CATEGORY II: Type of Reward for Successful Contrast 

1* Bonus Points 

2* Free Time 

3* Recognition 

4. _____ 

6. ~ 



CATEGORY Ills 



Duration of Contract 



CATEGORY IV: 



1, One day 

2. One week 
3* One month 

4. 

5- 



Grade Level of Pupil 



1, K-3 

2. 4-6 

3* 7-9 

4* 10-12 



CATEGORY Vs 



Contract Task 



CATEGORY VI; 



l s Homework Assignments 

2. Orderly behavior 

3* Completion of olasswork 

4, ■ 

Contractor 



1, Title VI Staff 

2, EH Teacher 

3* Classroom Teacher 

4. 

5- " 
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CATEGORY VII i 



CATEGORY Villi 



CATEGORY IX i 



CATEGORY Xi 



Contract Used For 

1 • Individual 

2, Class Group 

3 ■ Boys Group 

4* Girls Group 

5. 

6. " 

Sex of Contractee 

!• B^r 
2, Girl 

Contract Outcome 

1. Successful 

2 , Unsuccessful 



1, 
2, 



Interpretation 

Through the format outlined above f the contracts can be inter- 
preted and analyzed in a number of productive ways as listed below i 

1. Successful vs. Unsuccessful contracts could be compared 
overall, (IX) 

2* Specific "areas of improvement" desiredi could be analysed 
separately. (I) 

' J* Specific "grade levels" could be analysed separately* (IV) 
4* Six differences could be analyzed. (VIII) 
5* Other analysis as desired. 
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oqntoact count 

Title of person Gompleting form =- _ = _ BBS= ___ 

Date 

(PRE - POST) 



Form i w^written 
v-varbal 



Aiti behavior 
time 



Payoffs 



Goal Reached t 
Yes^No 
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INFERRED PUPIL SELF CONCEPT RATING BY TEACHER (E) 

This instrument was developed to measure teachers 1 opinions- 
of their pupils 1 self-concepts * Furthermore , we sought to determine 
if teachers 1 opinions were correlated with children's actual self- 
ratings, Thus, this form can be used in conjunction with Form F 
(which follows)* Each of the seven items on this form is keyed to 
a similar item on Form E (see section 1.2 of the report for a 
complete discussion, ) 

■■ if '" 

Based upon our finding, in the present project evaluationj 
that teachers 1 perceptions do not correspond at ail to their pupils 
self- ratings, we would not recommend the use of this instrument in 
isolation. Further research is necessary to completely discount its 
usefuliness, however. In conjunction with this, we would recommend 
a slight modification of this instrument so that its results could 
be compared with our suggested revision to Form F (see next section). 
We suggest changing the items in this form tot 

1, Coming to school in the morning, 

2, Reading aloud in class, 

3, Doing arithmetic, 

4, Being called on in class, 
J, My visiting his/her home, 
6, Doing homework 

7* His/her parents visiting my classroom, 
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INFERRED PUPIL SELF - CONCEPT RATING- BY TEACHER 
Student r s name rv,+* 



Sch ° o1 Rater 



Grade/room Relationship 

EH Teacher s 
Regular Teacher, 
Counselor 

Instructions i 

(1) Pill in all of the above information, 

(2) Cheek appropriate blank between like and dislike to 
indicate your appraisal of the student's attitude 
for each item. — — 



PLEASE GIVE YOUR DEPRESSION OP HOW THIS PUPIL CURRENTLY PEELS ABOUT t 



I. 


Being in school 


Dislikes % 


_ I Likes 


2, 


Being around teachers 


Dislikes i 


- : Likes 


3. 


Arithmetic 


Dislikes % 


s _ i Likes 


4, 


Reading 


Dislikes i 


J - ri Likes 


5. 


Homework 


Dislikes z 


* % Likes 


6. 


His or her appearance 


Dislikes * 


% m Likes 


7- 


Overall scholastic 
ability (his or her) 


Lacking % 
Confidence 


% s Quite 

Confident 



coM*rarsi 
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PUPIL SELF CONCEPT DJVENTQRY (P) 

This instrument was developed initially by project staff and 
later revised by the ©valuators on the basis of an informal item 
analysis. The origin of many of the items is obscure | many of them 
were created by project personnel and some, undoubtedly, were taken 
from other inf ormal inventories used by other researchers • 

During the first two years of the project, the instrument con- 
tained imny more items than the present form* At the end of the 
second year, an item analysis was done on the pre-post data collected 
.during the second year* Several items were discarded which did not 
elicit response frequencies amenable to change, i.e.., they were 
characterized by a ceiling effect on the pre-test and thus , were 
incapable of showing improvement over time, 

The present instrument, composed of 53 items in 5 different 
categories, has been extensively analyzed on the basis of two test- 
retest reliability studies with non-project children during the 
1973^74 academic year* 

The first pilot study was carried out in November, 1973 ? at 
Lawton Elementary School, San Francisco, using a sample of 18 fifth 
grade pupils. The j5>-item instrument was administered to the subjects 
in paper-and pencil fashion with items read aloud by the administrator. 
This procedure was repeated with the same children two weeks later, 

The results of this first study showed that, on the basis of 
an item- by-item analysis, approximately two- thirds of the items had 
teat- retest reliability coefficients (Pearson) significant at the 
,05 level or beyond* When total scores for each child were correlated 
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the overall reliability coefficient was .75 for the entire inventory. 
The second reliability study was done at the same elementary 
school with a different fifth grade class in May, 1974, The reason 
for carrying out this second pilot study was to determine if a pupil* a 
knowledge of his prior responses (a procedure used in the first study) 
might have influenced his second set of responses (retest). The re- 
sults of the second study agreed closely with those from the first, 
About the same proportion of items had significant test-retest 
coefficients of reliability, When the item coefficients were summed 
and averaged using Fisher's ^-transformation formula, the average item 
test-retest coefficient of correlation was .51', It was noted, however, 
that some item correlations differed markedly on the two separate 
studies. Whether these changes were due to the differences in test 
administration noted above, or whether they were the result of measure- 
ment error is not entirely certain. 

On the basis of our fairly extensive analysis of this instrument 
we recommend that the number of items be drastically reduced to those 
which (1) had significant test^retest r's on all administrations, (2) 
have means which generally fall between 2 and 3 on the ^point scale, 
and (J) fail under the specific ruble of education, rather than psychology 
in general, Such an instrument would be composed of the following items; 

1 s Coming to school in the morning 

2. Reading aloud in class, 

3. Doing arithmetic, 

4. Being called on in class, 

5- If the teacher visited my home, 

6, Doing homework, 

7. If my parents visited the school* 
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This instrument would be much shorter and easier to administer 
and it would reflect attitudes which oould be changed through educa- 
tional intervention. We suspect that a sunroed score based upon re- 
sponses to these itema would be a very accurate and useful indication 
of a student's "educational" self-concept, 
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CALIFORNIA TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SERVICE CEOTER 



PUPIL SELF - CONCEPT INVENTORY 



1st 2nd 
Session ____________ Session 



Data and time of day Date and time of day 



Recorder - Recorder 
Other players, if any ■ 



Instructions: This game may be played with one, two, or three 

children, Be sure to indicate the names of all 
children who play at one time above, Pill out 
one summary sheet for each child and be sure to 
record the color of his card deck, All items 
should be read aloud by the child or, if he 
cannot read, by the teacher* For research 
purposes f the second game session must be played 
with same number of players as the first, though 
not necessarily with the same individual children. 




2. Being alone 



3, You are not sure what 
people want you to do 
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^^^^ 


f e o \ 


4 


f e e \ 

\ K J J 


QUESTIONS 


First 
Session 


Second 
Session 


Change 


4, Someone hollers at you 








SUB TOTAL SCORE 








ABOUT SCHOOL AND LEARNING 








5* Coming to school in the 
morning 








6, Reading aloud 








7* Doing written work 








8, Doing arithmetic 








9, Taking a test 








10* Going to art time 




1 




11* Time for music 








12, P. E; time 








13. Time for science 








14, Leaving your classroom 
to get special help 
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QUESTIONS 


First 
Session 


Second 
Session 


Change 


13 * Social Studies time 








l6 * Being late for class 








x f m Deing a^itiQ uo stay 
after school 








18* When there is no school 








19. On report card days 








SUB TOTAL SCORE 








ME AND MY TEACHERS 








20 Being called on in class 








21. Being arc -id my teachers 






• 


22, Your teacher calls and 
talks to your parents 








2.5. Teacher shows your work 
to the rest of the class 








24, If teacher visited my 
home 
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. (x) 


/ * * ^ 
1 • i 




f * 

3 \> 










QUESTIONS 


4 First 
S^sion 


Second 

Session 


Change 




23 « Teacher comes t© my desk 




















OTHER GROWNUPS AND ME 










26. Seeing or hearing the 
princ ipal » vice- 
principal ? or dean 








27 > A sub in your room 








Seeing your counselor 










SUB TOTAL SCORE 




— — : - 
» .__„_. J 






m AND MY FAMILY 






- 


29» Doing homework at home 








30* Parents visit school 








31. Walking in your front 
door 








32, Playinf with your 

brothers and sisters J 
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1 vo/ 






7(5 


5 


4 




qUESTIC 


NS 


r irst 
Session 


oeconci 
Session 


Change 


33, Eating together as a 
family 
















SUB TOTAL SCORE 
















GRAND TOTAL 









Observations 1 Please note any information concerning the response 
pattern or other behavior of the child which you 
feel is important, 
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TEACHER RATING OP PUPIL ACADHCCC PERFORMANCE (0) 



At the time of referral the teacher fills out this form to 
rate the pupil 1 a academic skill levels in reading, arithmetic, 
spelling and language* These ratings are to serve as measures of 
the teacher's perception of the academic performance levels of the 
pupil, The ratings are made on a continuum ranging from one to 
four points* These levels can also serve to pinpoint priority 
areas for academic remediation. 

The form was used on a pre-post intervention basis in the 
current project. It can also be used on a pre-during-post basis. 
The ratings were analyzed for changes in level. The statistical 
procedure applied was the correlated T-test. (See the description 
of Form A, Student or Class Referral Form* for a discussion of 
inter-rater reliability) . 
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CALIFORNIA TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SERVICE CENTER 



TEACHER RATMG OF PUPIL ACADEMIC PERFORMANCE 

Title of person completing form 

Date 

(PRE - POST - OTHER) 

A, Student's name /or B, Classroom 

Birthdat e ^^^^^^^^^^^ 

Teacher Person Servicing ____ 











III* Academic Level 


More than 2 
levels 
below 


Below 
level 
grade 


Within 

grade 

level 


Above 
grade 
level 


I, Reading 










2 • Language 
2a • Oral 










2b, Written 










3* Arithmetic 










k t Spelling _ 










5* Handwriting 










6, Science 










7, Social Studies 
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9/73 



WORK SAfCPLES (H) 



Work samples serve as idographie measures of student progress 
in specif io academic areas* Baseline work samples can be defined 
for tasks such as arithmetic computation, reading comprehension, 
handwriting, and written expression* These samples should be de- 
fined conjointly by the project staff members and the referring 
teacher at the inception of a remedial program* The specific 
criteria to be used in evaluating pupil progress should also be 
defined prior to the remediation program as well* The criteria 
should be individualized so as to fit each student's entry level 
skills and the goal the referring teacher wished to set. 

Analysis of the results of the work samples could be done by 
types of task, pre-remediation level, and post-remediation level 
evaluation of skill proficiency. Therefore, the results could 
be analysed in terms of the percentage of work samples that met 
criterion on the post-remediation evaluation, Individual student's 
projects could also be analyzed to determine changes in error 
responses and correct responses, 
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CALIFORNIA TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SERVICE CENTER 



WORK SAMPXJIS 



Title of person collecting 
Date 

Check on© of the followinsr* 

Pre sample 

Post sample 

Other 
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WIDE RANGE ACHIEVaffiOT TEST (WHAT) (I) 



The WRAT (Jastak, Baer, and Jastak) was administered to all 
pupils referred to the project prior to their involvement in any 
intervention programs. The teat was selected as a standard measure 
of grade level achievement in reading word attack skills, arithmetic 
computation, and spelling, The WRAT is widely used and is a standard 
measure for admission * retention, and evaluation of almost all 
students' enrolled in special education programs in California, 

The WRAT was administered on a pre-post intervention basis, 
a gain/month score was computed in each area for each pupil so 
assessed* The difference between the pre-post achievement scores 
was first determined and then this was divided by the number of 
months the pupil had spent in the program. Then, a mean gain/month 
was computed by level (i.e. , primary, upper elementary, and junior 
high-secondary) and by area (reading, arithmetic, and spelling), 
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CALIFORNIA TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SERVICE OMTKR 



WIDE RANGE ACHIEVEMENT TEST 
(sea test manual for instructions) 
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COPYRIGHT, 1965 by 
Guidance Associates 
ef Delaware, line, 
]%2h Gilpin Avenue 
Wi! ming ten, Delaware 



WIDE RANGE ACHIEVEMENT TEST 

Reading, Spelling, Arithmetic from Pre-School to College 
By j. F. jastak, S, W ? Bijou, S. R, jastak 



Printed in U S A, 
19)7, 1946. 1963 
Revised Edition 
1965 



Name...... „, .... .... .Birthdate 

School .... = Grade .. Reading Score,,,., 

Referred by...,., .== ... ...Spelling Score. ...... 

Date .... Examiner .. Arithmetic Score, 



= M, F, Chron, Age .. ........... 

Grade . ; Stand-Se, ........ . r / t ile 

, Grade,, 

.Grade . .=,.. . St and -Sc. . , '.'tile... 



.Stand-Se, , r -< ile. 



Pares nil lea and Standard Scares eerraapendtng is grade rating* and ag* may ba found in the Manual, 



Laval l^-"Sp*liing-^Grada Norm!. 



Score Grade 


Sn>re Griide 


Sourr 




Hciini Gradr* 


Soon- UrmU- 


Soorr Graiif 


^HH Jrt Urn ile 


Brure G 


rflde 


ScOrr 


Urnde 


St ulV (initji- 


Srt'jf i" 


Gftllit 


1 


N.4 


It 


Kg, i 


i3 


1,5 


34 


3,0 


45 


5.7 


SO 


10,3 


0 




11 


4,0 




0,? 


31 


»,ll 


41 


H,4 




N,8 


Ui 


Kg,5 


i\ 


1,U 


35 


3,« 


4 a 


0.0 


57 


10,11 


1 


Kg,0 


If 


4,3 


a 


0,8 


M 


(UJ 




N.H 


3 


Fk,i 


H 


Kg.O 


u 


1.7 


30 


3.3 


47 


0,3 


58 


11.5 


i 


Gr,L0 


13 


4,0 


13 


7.0 


33 


0.0 


43 


11* 


4 


Pk.< 


13 


KK.7 


iU 


1.H 


37 


3.7 


48 


0,5 


50 


M.i 


3 


1,3 


14 


4.0 


<4 


7,i 


31 


0.0 


M 


130 


5 


Fk.:i 


10 


Kg,8 


<7 


<,0 


88 


.1.H 


49 


U.8 


00 


V±Q 


4 


1.0 


15 


5.* 


i3 


7.4 


83 


10,< 


45 


14,0 


6 


Fk.5 


IT 


K*l» 


*B 


iA 


39 


4.* 


50 




01 


13,8 


5 


1*0 


10 


3,5 


«fl 


7,0 


as 


uu 


40 


IM 




Pk.T 


!8 


Ur.LO 


*fl 


<,3 


40 


4.5 


31 


7,7 


0* 


14,5 


0 




17 


5.8 


*7 


7,H 


87 


10,8 


47 


15,0 




Fk,9 


If) 


L! 


30 


*.s 


41 


4,7 


hi 


8,* 


m 


15,< 


7 




IB 


0,1 


*8 


B.l 


an 


11.4 


43 


15,7 




Kg,i 


in 


h% 


ill 


<,« 


u 


5,0 


53 


8,7 


34 


13,0 


8 


3.0 


10 


0,3 


*0 


8,4 


30 


11.6 


40 


10.4 


10 
11 


K&i 
Kg,3 


a 
a 


1,3 
H 


34 
ft! 


4J 

<,o 


43 
44 


3.3 
5.5 


54 

55 


B.7 


03 


18,7 


0 
10 


3,3 
3,7 


*0 


0,5 


30 


8,7 


40 


WO 


50 
51 


MA 
18.0 



Level 11— Sp«lUn 



fade Nsrmi, 



Spelling Scores 



Level ! 




Level H 


Cumul 


Cumul 


Teat Score 


Test Score 


Copying 




Copying 


1 point 


I 


4-9 1 


per 


la 


10-1 7 2 


mark 


IS 


18 3 


Name 




Name 


1 letter 


io 


I lqtU'f 4 


2 leu era 


20 


2 W'lu-rs 5 


Spelling 




Spelling 


1 point 


21 


I ] joint 6 


pef 


to 


jwr to 
word 51 


ward 


65 





! 


/ 


\ 


O 


X 


J 


y 


n 


A 


A 


r 






U 


V 


c 


n 
























r 
















I4.«_ 



__ 30, 
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Page 2. Arithmetic 

LEVEL !, Orai Part # 

XV IX 9 

3 pennies, spend I 



3 Fingers, 8 fingers, 9 or h} 42 or 28? 



3 r 4 applcs?_ 



9 inarbles, lose 5? = 



Written part, 

i + i - 

4 - 1 ^ .... 



6 

+ 2 



3 2 

2 4 4 X- 2 - 

+ 40 



2 3 

X 3 



2 9 
- 1 8 



7 5 

+ 8 



29 



4 5 2 
I 3 7 
+ 245 



$ 6 2,0 4 1 | hr, 

- 5.3 0 



6)968 



i 4_ J. 

3^3 



35 



7 5 



8 2 3 
X 96 



i yd. - 



4 I 

+ 2 A 



| of 3 5 



14 - 



2 7 ) 3 8 4 



12 



5 



2 ^ doz* 



mo. Multiply; 7.9 6 
3 0,8 



Which is more? 


Find the average of 


Write as a percent 






t or i 1 Ans, 


24, 18, 21, 26, 17 
Am, 


3 _ Vf 

4 ~ — /O 
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_3_ ^ 3 
1 0 " 4 



8 v £ v i. — 



Write as decimal: 
I - — 



20% of 120 
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F*2 ) 6 2,7 G 3 



6 5 = 



Change to familiar 
numerals: 

M C X L II - 



( - S) ( + 9) - 



60 



Find interest on 

$?0O at 4|% for 7 mo, 

Ans, - - 



Solve: 

y + ( 9 ^ 8y ) 



Find 



square root: 



6 5 



Hi- 


• rr (iridic 


S«»ft 


(•rmlr 








Hi rtjtv 


Grrtile 


S€U7l> r Jr 


•*«* GrMtiii 


S<*wrt 


i (*r*dc 


Henri (,r»n 


1 


N.5 


H 


KV.I 


i t,-i 




>H 


4 J 




.1,11 






m 


10,0 


5? 1 U» 




SM 


') 




> 


<if,Ui 


4M 


i.i 


HQ 


M 




■ .' ft 


51 


!0,7 


58 15,0 




VkA 


in 






i,i 


** 


iA 


-n 


1*4 






5^ 


11,4 


50 io^i 




Vkti 


11 


K*l 


! in 


1,1 


43 




\H 


t s 5 




i 4 >i 1 


53 


14,1 






VkA 


!i 


K*,1 


; hi 


i,B 


^11 


4,H 


-A:i 


4.7 


40 ft ? 


»,i 


3| 


H,« 




rt 


VkA 


hi 


Ka,« 


j#i 


M 


17 


3=0 


'ii 


.1,0 




B,H 


55 


19,5 






VkM 1 


u 






iJ 




M 




5,4 I 


44 *,3 


I 4W i>,4 


5(1 


14,4 
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RATED ASSlSa^IT READING (J) 



All pupils referred to the project who evinced reading problems 
were given the Rated Assessment Reading prior to remedial programs 
being initiated. The Rated Assessment tasks are based on a precision 
teaching measurement system (Kunzelmann, 1971 i Alper & White, 1972 f 
et,al, 1973). The pupil is given a one-minute timed trial on specific 
criterion-referenced reading skill sheets (i.e., letter sounds, 
3-letter c-v-c- words, 4-letter e-v-o- words, S-letter e-v-c words and 
Dolch words). Correct and errors per minute are computed for each 
sheet separately. In this way the effects of specific remedial pro- 
grams can be monitored. Grade level measures lead to global assess- 
ments and are not criterion referenced. The rated assessment provides 
a skill specific measure of pupil growth. The rate also has advan- 
tages over percentages or simple frequency counts in that it provides 
both a measure of speed and accuracy* As many referred pupils are slow 
and non- fluent readers, their rate of performance is an important 
criterion in evaluating the success of remedial programs. 

The rated assessment-reading was administered on a pre-post 
intervention basis, Specific instructions for the administration of 
the assessment are included with the instrument. Separate correct 
and error rates, for each subject on each skill, were computed in both 
assessments, The mean correct and error rate was determined by level 
for each skill pre-and post-project intervention (primary, intermediate 
junior high and high school), A correlated T-test was completed 
separately for the correct and error rate means, by level, to deter- 
mine any significant shifts in rate, 
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The data was also compared "bo mastery rate tables * The mas- 
tery rates provide a correct and error rate range that indicates when 
a student is proficient in a specific oral reading subskill. The 
combination of correct and error rates specifies both fluency and 
accuracy for each skill. 

An accuracy ratio and percentage of accuracy (Pennypacker f 
Koenig f and Lindsley, 1973} were computed for each skill both pre-and 
post- training. The accuracy ratios and percentages of accurary pro- 
vide information as to the relation between correct and error rate. 
Accuracy ratios are computed by dividing the larger of the two rates 
by the smaller of the two rates* For example, if the correct rate is 
2/minute and the error rate is l/minute the accuracy ration would be 
2/1=2. If the correct rate is larger then the accuracy ratio 
assumes a times function which is denoted by an X (in our example we 
would have a X2), If the error rate is larger then the accuracy 
ratio assumed a divide-by function which is denoted by an 4 (If errors 
were 2/minute and correct rate was l/minute the accuracy ratio would 
be 2/1^42). The percentage of accuracy is then determined by dividing 
the correct rate/minute by the total number of responses made per/ 
minute (correct rate a error rate/minute), As in our example with 
a correct rate of 2/minute and an error rate of l/minute, the accuracy 
ratio would be 2/2+1-2/3 or 66 2/3$* 
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CRITERION PERFORMANCE RATES 



Mastery 
Correct 



Incorrect 



2, 

3. 



Sounds 

a* Consonants 
b* Vowels 

Note i We have started the child 
on three letter words 
following their reaching 
a rate of 4o/min of con- 
sonants and vowels. We 
still continued to work 
on the sounds only stopping 
after the child reached 
80/min on both, 

Alphabet Names - (optional) 

Phonetically Predictable 
Words - (3, k, 5 letter) 



4. Sight Words - (Predictable 
and unpredictable) 

5, Reading in Book - (at all 
grade levels) 

6* Minimum Rate for Choosing 
a Book 



90/min 
90/min 



8o/min 

(3) 80-85/min 
W 70-75/min 
(5) 60-65/min 



100-120/min 



50/min 



1-2/min 
1-2/min 



1-2/min 

1-2/min 

1-2/min 
1-2/min 



60- 80/min 1-2/min 



1-2/min 



4r? n 
i O 



1 o 



CALIFORNIA "TITLE VI-G PROJECT 
PUBLIC SCHOOL MODEL SMVIOE CENTER 



RATED ASSESSMENT * READING 

Introduction: WE HAVE BOm TIME TO SPEND TOGETHER * SHARE WITO MB 
WHAT YOU HAVE LEARNED ABOUT LETTERS AND WORDS THEN 
YQUR TEACHER AND I WILL BE ABLE TO GIVE YOU TASKS 
THAT YQU CAN DO AND TASKS WHICH WIUL TOL? YOU " 
I£ARN TO USE MOfiB DIFFICULT WORDS , 

Item 1 Manuscript Alphabet Recognition 

9 

Place the stimulus sheet for Manuscript Letter Re* 
cognition in front of student. Place the score 
sheet in such a way that the student is not dis- 
tracted by the scoring process* 

Verbal directions to student i 

SAY THE IWES OF TOffiSE LETTERS 

BEGIN HERE , (Point to the first one,) 

Verbal directions to students 

READY - BEGIN (Begin timing for one minute) 

Time for one minute* 

Verbal direction to Student! 

STOP 

Make a positive statement based on observed 
performance , 

Example! (You worked for a minute) 

Mark on a duplicate sheet each error and the 
place where the student stopped. Record on 
the score sheet the number read correctly f the 
number read incorrectly and the date. 

If the student has difficulty with an item, ask 
him to try the next item, Count omissions as 
errors. Count the student's first response 
in scoring, 

Items 2-5 Three, Four, Five - Letter Mixed Vowel Words 

(I minute sample) and Poleh Sight Words (30 
second sample) 

Place the stimulus sheet in front of the 
student 

Verbal directions to students 

READ EACH OF TiffiSE WORDS OUT LOUD . BEGIN EffiREU 
(Point to the first one.) 
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Allow student to read in the direction he 
chooses and indicate with an arrow student f s 
choice of direction. 

Verbal directions to student | 

RMOT - BEGIN (Begin timing for one minute - or 
30 seconds for Dolch sight words,) ..-..♦= 

Time for one minute, 

Verbal directions to students 

STOP "'• • 

Make a positive statement based on observation, 

Mark on a duplicate sheet each error and the 
place where the student stopped. Record on 
the score sheet the number read correctly, the 
number read incorrectly and the date, 

If the student hesitates on an item, ask him 
to try the next item. Count omissions as 
errors* Count the student's first response in 
scoring* 
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RATED ASSE3S*ffiNT-*REABOTG (ONE MINUTE TASK) 

Pre i Mid 



Post 



Corr » 



Err, 



Corr* 



Err* 



1. Manuscript Alphabet 
Recognition 



2, 3 Letter Mixed 
Vowel Words 



3. k Letter Mixed 
Vowel Words . 



4 ( , 5 Letter Mixed 
Vowel Words 



5, Dolch Sight Words 



6. Oral Reading 



Comments : 
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sat 

bus 

r i d 

keg 

rat 

pod 

bug 

mat 

log 

beg 

fig 

mug 

bog 

wed 

ram 
ERIC 



hub 

top 

w i n 

vet 

ga I 

keg 

r i p 

nap 

pod 

sun 

log 

jam 

peg 

I id 

tug 



dot 

pup 

t i n 

rap 

I eg 

bi g 

hot 

bum 

had 

net 

s I n 

lot 

gum 

nab 

beq 



deb 
cub 
fad 

pig 

mob 

cud 

wag 

yet 

I id 

sod 

hum 

sad 

men 

h i m 

rod 



hunt glen I ump crab 

shop slit pond shot 

fink drag slip fret 

self blob tent twig 

sang gust gang bond 

bend shop spun junk 

trim shut flop twin 

tang crop rink best 

pump thin * then path 

cost best span gush 

wish hunt fled I imp 

vest long mink lost 

that slid chop mesh 

jump stem vast plum 

clot glad vest sung 
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b I end 
g I and 
sling 
s I ush 
*%! ank 
th i nk 
crush 
s i epf 
brash 
sting 
trunk 
b I ond 
c I ank 
crept 
br i nk 



th i ng 
blast 
grant 
p I ush 
f I esh 
drank 
stunk 



s I i ng 

trend 
b I ush 
s I ang 
chest 
fling 
c I unk 
p I ant 



f I ush 
b I and 
quest 
split 
stank 
swept 
drunk 
br i nk 
grand 
f resh 
qui It 
s I unk 
blast 
crest 
f I ank 



bl ink 

spend 
s I ant 
crest 
chunk 
drink 
thank 
spent 
st i nk 
f I unk 
cramp 
trend 
bl ind 
skunk 
cramp 
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and 

can 

come 

fast 

get 

r i de 

see 

the 

a 

f or 

go 

green 
he i p 
here 



i s 

red 

said 

stop 

this 

to 

want 
we 

work 
you 

big 

b I ue 

down 

funny 

have 
j-n 



I ittl 

I ook 
make 
not 

play 

up 

what 



RATED ASSESSMENT MATH (K) 

All pupils referred to the project who evinced math computa- 
tion problems were administered the Rated Assessment Math prior to 
remedial programs being initiated* The Rated tasks are based on a 
precision measurement system (Kunzelmann, 1971 I Alper & White, 1972 ? 
Alper, et.al, 1973)*) The pupil is given a one-minute timed trial 
on each of the specific arithmetic computation skill sheets (i.e., 
reading numbers, counting groups of dots, addition single digit, 
addition with carrying, subtraction with borrowing, multiplication 
single digit, and division single digit)* Correct and error rates 
per minute are computed on each sheet. In this way the effects of 
specific, remedial programs in arithmetic computation can be monitored, 
Grade level measures are often too global and are not criterion re- 
ferenced. The rated assessment provided skill specific measures of 
pupil growth. The rate of performance also has advantages over per- 
centage or frequency counts ; it provides both a measure of speed and 
accuracy of responding* As many referred pupils are often slow and 
inaccurate in their basic computations rate is an important criterion 
in evaluating the success of remedial programs, 

The rated assessment math was administered on a pre -post intervene 
tion basis. Specific instructions for the administration of the assess- 
ment are included with the instrument* The same data analysis procedures 
were utilized for the rated assessment math as for the rated assess- 
ment reading, (see Form J) 
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CRITERION PERFORMANCE RATES 



Mastery 

Correct Incorrect 

1. Counting in Sequence- 80-100/min 1-2/min 

child requested to count 
(child goes from 0-15? 
then back to 0 and begins 
again* 

Note! child should be able to 
count all numbers in sequence 
before he is ejected to add 
them. 



2, Write Numbers in Sequency- 60-8o/min 1-k/mln 
(from memory, on request) 

Note: If entry rate below 
5» try coping or tracing, 

3* Write Numbers Out-of ^Sequence- 5 — 70/min l^k/min 
(from memory, on request. 

4, Write Numbers for Legibility 20-4o/min 1-2/min 
and Accuracy. 



Note i In order to solve add, 
subtract, multiply, and divide 
at 30/min, the child needs to 
be able to write numbers at 
least 48/min* This would be 
minimum proficiency before 
number facts could reach 
criterion* Number writing is 
usually times 1,6 the rate of 
number facts (48 n,w, mastery is 
1,6 times 30 n,f,) 

5. Read Number - (0-9i 0-20 f - 60-80/ndn 1-2/min 
either in or out of sequence) 

Notes Reading numbers in sequence 
is a separate skill from reading 
out of sequence. Each should 
be assessed separately, 

6. Count Groups - (like number con* 4o/min 1-2/min 
cepts e*g, 111, 1, 11) 
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Notes Before a child can 

add a program in counting groups 

or identifying groups of objects 

might help to teach number 

concepts, 

7* Computation - (+ f ~, x, 45 
of single digit numbers 



Mastery 
Correct 



Incorrect 



30/min 



1-2/min 



Notes If a child is unable to 
perform on a sheet of number 
facts at a median rate of 20 
in the first 3 days then you 
have to slice your pro-am. 
If teaching sums 0*9 slice 
to sums 0*3 p 

8. Computation - (+, x, 4) 
with borrowing or earning 
in one digit* 



20-25/min 1-2/min 
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CALIFORNIA TITLE VI-0 PROJECT 
PUBLIC SCHOOL MODEL SmVICE CENTER 



RATED ASSESSMENT - MATH 

Introduction i WE HAVE BOm TIME TO SPEND TOGETHER - SHARE WITH ME 
WHAT YOU HAVE LEARNED ABOUT LETTERS AND WORDS TOM 

fore mkcam and i will be able to give you task s" 

THAT YOU CAN TO AMD TASKS WHICH TOLL HELP YOU 
LEARN TO USE MORE DpyiCULT WORDS . % 

Item 1-2 Number Reading (0-20) f ( 0-100). Use with students at 

grate levels 1^3| and with students who sears 10 or 
less on computation. 

Place the stimulus sheet in front of student* Verbal 
directions to student* 

READ THESE NUMBERS ALOUD , BEGIN limE * (Point to 
the first one.) 

IF YOU FIECTSH BEFORE I SAY STOP* SO TO THE TOP OF 
THE PAGE AND CONTINUE READING 

Verbal directions to students 

READY * BEGIN, (Begin timing" for one minute). 

Time for one minute 

Verbal directions to students 

STOP 

Make a positive statement based on observations* 
Example: (You did 12!) 

Mark on a duplicate sheet each error and the place 
where the student stopped* Record on the score 
sheet the number read correctly, the number read 
incorrectly and the date* 

If the student has difficulty with an item, ask him 
to try the next one, Count omissions as errors. 
Count the student f s final response in scoring* 

Item J Number - Set. Use with students at grade levels 1-3| 

and with students who score 10 or less on computation 

Place the three worksheets in front of the child- 
one on top of the other* 

Verbal directions to students 

MARK Tm NUhfflER THAT MATCHES Tffl DOTS IN EACH BOX , 
BEGIN HERE . 

(Point to the first one,) 

Verbal directions to students 

REAjy - BEGIN (Begin timing for one minute*) 
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After one minute - 

Verbal directions to students 

STOP 

Make a positive statement based on observations, 
(Example i You finished 20!) 

Record on the score sheet the number correct, the 
number incorrect, and the date, 

In the event he changed a response, count the 
final response of student on each item. 

Items 4-11 Computation (Addition, subtraction, multiplication, 

division) 

Place the stimulus sheet in front of the student. 
Ask the student which format for simple addition 
and subtraction facts he prefers, vertical or 
horizontal, 

(This will help the examiner in determining which 
stimulus sheets to present the student*) 

Verbal directions to student! 
work Tmm Pumimts. 

BEQBJ HERE t (Point to the first one,) 



Verbal directions to student i 

RBAPy - BEGIN. (Begin timing for one minute,) 

Time for one minute* 

Verbal directions to Students 

STOP 

Make a positive statement based on observation, 

Addition/Subtraction involving carrying, borrowing 
or remainders - score 2 points each (1 point for 
one's column and 1 point for ten f s column) (Two 
point maximum) 

Multiplication - score 1 point for one f s column and 
1 point for remaining place (s), 
( Two point maximum) 

Division - score 1 point for whole number in quotient 
and 1 point for remainder, (two point masdjaum) 

If the student hesitates on an item, ask him to try 
the next one. Count omissions as errors, Count 
final response on each item* 
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RATED ASSESSf^T-MATOI 





yU= J- ■ 


Err • 






Corr « 


Err* 


1, Number Reading (0-20) 














2. Number Reading (0-100) 














3» Number - Set 














4* Addition (1-18) 














5 t 2-Digit Addition-Carrying 














6 f Subtraction (l-l8) 














7. 2*Pigit Subtraction-Borrowing 














8, Multiplication (0-10) 















9t Multiplication-Carrying 






— — r i 




... 




10* Division-Simple 
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11, Division-Remainder 
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9+6= 

7+2= 
7+9= 
9+2= 
</+8= 
6+2= 
8+2= 
5+1 = 
7+8= 

'4+5= 
2+7= 
9+0= 
2+3= 
9+4= 

£+8= 
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7+3= 
5+1 = 
7+1 = 
5+8= 
3+1 = 
5+5= 
3+7= 
6+2= 
0+7= 
3+7= 
1+8= 
4+3= 
5+7= 
4+4= 



9+4= 
9+7= 
5+7= 
9+3= 
8+5= 
6+6= 
1+4= 
8+9= 
5+6= 
8+8= 
1 + 1 = 
2+4= 
6+7= 
9+3= 

'9+9= 
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RATED ASSESSMENT - ORAL READING QUHIOBE (L) 

The Rated Assessment Oral Reading was administered to all 
pupils referred to the project who evinced reading problems. The 
oral reading task was designed to be a measure of oral reading rate 
for words in context, Each pupil was given a timed trial in reading a 
word passage taken from the Gilmore Oral Reading test both pre- and 
post- project intervention, A JO-seeond period was allowed for pass* 
ages grades 1*4 and a 1-rainute period for passages grades 5*7 • ^h® 
passage was chosen based on the student ? s Wide Range Achievement Test 
Reading Score, If the pupil scored at the 1,0 grade level he was given 
the 1,0 grade level passage from the Gilmore, When the pupil's score 
was at the 1,5 grade level he was given at 2,0 Gilaore Oral Reading 
passage. The same procedures were used to define grade level passages 
for students reading on the WRAT at any level* Therefore, in all cases 
when the pupil read at ,5 or more above the grade level score on the 
WRAT we rounded off to the higher grade level to determine the Gilmore 
Passage appropriate for him, 'Hie same passage was administered on 
the pre- and post-test. 

The Rated Assessment Oral Reading was scored in the same way 
as all of the other rated reading tasks,, Pre and post* intervention 
correct and error rates/minute were computed, A T-test for correlated 
means was computed to determine if the changes in either correct or 
error rates were significant from pre-post intervention, Accuracy 
ratios and percentage of accuracy were computed (see discussion of 
oral reading rate in appendix) , 
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CALIFORNIA TITLE VI-0 PROJECT 
PUBLIC SCHOOL MODEL SElvTCE CENTER 



BATED ASSESSMENT - ORAL READING (GIMORE) 



Student 



School 



Person completing form 



Date 



(PRE 



POST 



OTHER) 



Item 6 Use Oilmore Oral Reading Test 



Select paragraph appropriate to student's reading level 
based on WRAT score * round off high (1.6-2 etc ) 
Time student for 30 seconds on paragraphs 1-4| and 
1 minute on paragraphs 5^10* 

Enter scores on Rated Assessment - Reading Summary 
Sheet, Item #6 (Form J) 4 
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RECORD BLANK 

Form C 




llmore 



Oral Reading 
Test 



by JOHN V. GILMORE 
EUNICE C, GILMORE 




VA HARCGURT, BRACE it WORLD, INC, 

NEW YORK CHICAGO SAN FRANCISCO ATLANTA DALLAS 
CnjjvfiMhi' I'H'H by Hiircaurt. Bruce & World, Inc. All rights reserved. Printed In U.S.A. 
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FORM C-l 



The girl has a cat, 
The girl is Mary, 
The cat is Puff, 
Puff is gray, 
Father is in the yard. 
Father works hard. 



TiME____SiGonds 

1. What Is the girl's name? 

2. What is the cat's name? 

3, What color Is the cat? 

4, Who Is in the yard? 
_^ 5, What is Father doing? 



ERROR RECORD 


Numbtr 


Substitutions 




Mispronunciations 




Words pronounced by examiner 




Disregard of punctuation 




Insertions 




Hesitations 




Repetitions 




Omissions 




Total Errors 
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Gommmc? rating of special or regular ieachers (m) 

This form was utilized by the project staff to rate the special 
teachers and regular teachers who had intensive contact with the program 
The form can be used both prior to and following contact with a training 
program. Each item on the instrument covers a specific behavioral com- 
petency considered important for teachers of educationally handicapped 
children, A content analysis was completed on the items and they were 
found to represent all of the specific skill areas that were outlined 
from the project objectives, The items were also found to be weighted 
in the same way as the project objectives. No one instructional theory 
is represented by the items although they do reflect a Clinical Teach- 
ing model as put forth by Lerner (1972)* The basic steps in such a 
model are i diagnose, plan, teach, evaluate | and the questions follow * 
this sequence. 

The trainee f s skill in each of the major objectives is 
evaluated by the staff member who has had the greatest degree of con- 
tact with the trainee. The ratings are supposed to be completed 
after observation of the trainee in the teaching situation, The 
ratings are not to be shared with the trainee in order to reduce any 
sensitization effects but they can be used by the project staff to 
pinpoint areas for consultation, training t and follow-up, 

The form consists of two parts, The first section is divided 
into seventeen specif io questions. Each question covers a step in 
the assessment, data interpretation, objective statement, structuring 
the learning situation, teaching, reinforcement, and evaluation sequence, 
Every question has a separate set of descriptors for each level of 
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skill competence and use s These descriptors are arranged on a three 
point scale and the staff member rates the trainee on this scale, 
The second section consists of one question with eleven subparts. 
Each subpart is related to a specific learning modality area, academic, 
subject, or behavior, The staff member rates the trainee, in this 
section, on his skill in assessment of each of these areas. Every 
area receives two ratings, one for formal assessment techniques and 
the second for informal assessment techniques . The scale for this 
area ranges from l-*no knowledge of skill, to 4-knowa a variety of 
methods and uses one or more with proficiency. 

The form was utilized on a post- training basis in the current pro- 
ject. The data was analyzed to compute means and standard deviation 
on each item for the entire group of trainees following training. It 
can be administered on a pre-post basis and then the data could be 
analyzed for difference scores by item across the trainee group* The 
pre-post data could also be analyzed utilizing a correlated T-test 
to determine the significance of changes for each item. 
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CALIFORNIA TITLE VT><3 PROJECT 
PUBLIC SCHOOL MODEL SERVICE CENTER 



COMPETENCY RATDIO FOR SPECIAL OR REGULAR TEACHERS 

Title of person completing this form _ & ^____ = _^ i __ 1 ^ = _ = . 
Date 

( PRE " POST - OTHER) 

Introduction i This form should be used for teachers from the selected 
site schools. 

Ins true tions 

1. Read all of the questions on the form before answering* 

2, Make a visit to the teacher's school location to obtain both 
the observational and verbal information required to complete 
the rating* 

3* Observe the teacher working with individual students and with 
groups, 

4, Review teaching plans for individual students with the 
teacher* 

(Data for points 2, 3* ^ 4 may be obtained during your 
normal contact with the teacher* 

5* All teachers should be rated on as many questions as are 
appropriate, 

RATE Tlffi TEACHER ON THE BASIS OP BEHAVIORS CURRENTLY DEMONSTRATED 
Questions 

1* Does the teacher know how to select the appropriate diagnostic 
instrument (assessment tool, test) to fit the child's 
ability and/or disability area? (delete when rating regular 
teacher) 

1. Shows little discrimination in choice of tests. 

2, Shows adequate discrimination in choice of tests, 

3- Shows high degree of discrimination in choice of tests* 

2, Rate the' teacher's ability to use diagnostic test (assessment) 
results to * anerate individualized programs in regard to 
student strengths and weaknesses, 

1 9 Does not utilize any assessment data in planning for 
students, 



512 



"M" 

3/74 



2, Uses diagnostic test information to a limited degree in 
planning for students, 

3. Makes maximum use of diagnostic teat information in 
planning for students* 

Rate the teacher's use of instructional objectives for each 
student in his or her teaching plan* (An instructional 
objective must include a statement of the behavior , situation, 
description of the learner, and a criterion level) 

1, Teacher does not use instructional objectives, 

2* Teacher has instructional objectives for some students, 

but not for all areas or for all students (Areas^reading, 

math , spelling ) 
3- Teacher specifies instructional objectives for all 

students in all required areas (i*e, f reading, math, 

spelling) 

Are the teacher's instructional objectives individualized in 
terms of each students strengths and weaknesses (as deter- 
mined by formal and informal student assessments - see $18) ? 

1, Teacher does not take the student into account (i,e,, the 
objectives do not match up with the diagnostic data) 

2. Student objectives show a small degree of indi vi dual i z a- 
tion, (i«e,, in one area or for a small number of 
students) 

3* Student objectives are clearly related to individual 
patterns of ability and disability. 

Do the teacher's records show evidence that he or she monitors 
student progress towards the objectives? 

1 , There is no indication that the teacher monitors student 
progress, 

2, There is some evidence of informal monitoring of student 
progress, 

3, There is strong evidence that the teacher keeps on-going 
progress records for each student (records might include 
objectives based checklists, routine rated assessments, 
etc - ) 

Does the teacher modify the instructional objective, based 
upon student progress? 

1, Instructional plans are adhered to without modification, 

2, Instructional plans are infrequently modified when student 
either makes progress or fails to make progress, 

3* Instructional plans are continually evaluated and changed 
based upon student progress * 
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7. Does the teacher utilize a wide variety of instructional 
approaches for the individual student ? 

li Teacher utilizes one approach in each area, 

2. Teacher utilizes a few different approaches in each 

area (maximum of 2) 
3* Teaoher utilizes a wide variety of approaches in each 

area* 

8. Does the teaoher utilize a wide variety of instructional 
approaches for groups of students? 

1* The teaoher utilizes one approach in each area, 
2, Teaoher utilizes a few different approaches in each area 
(maximum of 2) 

3* Teaoher utilizes a wide variety of approaches in each 
area* 

9. Does the teacher develop and utilize individual reinforcement 
programs for student's social behavior problems? (see #10) 

1* Teacher does not use reinforcement systematically, 
2, Teacher uses reinforcers on a limited basis (with 1 or 2 
students ) 

3* A majority of student behavior problems are dealt with 
using a contingency management program, 

# A teacher who phases from tangible to social reinforcements should 
be rated highly. We are not just looking for the use of tangibles 
with students | only those who require them, 

10, Does the teacher develop and utilize individual reinforcement 
programs for students* academic problems (e.g, employs contracts, 
tokens , etc , ) * 

1, Teacher does not use reinforcement approaches systematically, 

2, Teacher uses reinforcers on a limited basis (with 1 or 2 
students ) 

3, A majority of student work is related to a reinforcement 
program* 

11, Does the teacher involve his student's in planning their own 
program? 

1, Not at all, 

2* Teacher asks students only infrequently about their 
preferences* 

3* Teacher frequently involves a majority or more) of the 
students in planning their own programs,, 
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Does the teacher utilize other personnel in planning and inbtruc 
tion for his students? (e,g, aides 9 learning center teachers* 
peer and cross age tutors, etc.)? 

1. Teacher does not use other personnel at all, 

2. Teacher uses other personnel on a limited basis, (not daily) 

3. Teacher uses other personnel to a high degree, (daily and 
with more than one student) 

Does the teacher exhibit confidence in sharing ideas with other 
"teachers on the staff with whom his students are involved? 

1, Teacher works alone and does not eoTrounioate with other 

teachers involved, 
2. . Teacher. has .limited communication with others . involved with 

student (only when formal re-evaluation is requested or 

required) 

3. Teacher has a high degree of communication with other 
teachers involved with the student, 

How responsive Is the teacher to acknowledging new ideas? 

1, Not open to new ideas* 

2, Will listen to new ideas but won't try out. 

3, Will listen and try out new approaches. 

Rate the teacher's ability to identify learning modalities 
for each student, 

1, Teacher does not know any of the basic learning modalities, 

2, Teacher knows all of the basic modalities but cannot 
identify. 

J* Teacher knows all of the basic learning modalities and 
can identify all of them, 

Rate the teacher's ability to locate and utilize materials 
appropriate to the needs of the class, 

1, Teacher does not know of the resources for appropriate 
levels or learning materials, 

2, Teacher knows of the resources for appropriate levels of 
learning materials, but does not utilize* 

3, Teacher knove of resources and utilizes them. 

Rate the teacher's ability to locate and^utilize resource 
personnel appropriate to the needs of the class, 

1, Teacher does not know how to locate resource personnel 
for her Glass, 

2* Teacher knows how to locate resource personnel for her 

class f but does not utilize them, 
3, Teacher knows how to locate resource personnel for her 

class and does utilize them, 

5,15, 
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18. Rate the teacher's ability to utilize an appropriate instrument 
for the following learning areas. Remember, one instrument 
may measure more than one area (e.g. ITPA measures both 
visual and auditory channels) 

The numbers used below indicate the following s 

1 = Doesn't know of any informal or formal methods in this area. 

2 - Knows of a single informal or formal method but does not 

utilize . 

5 ■ Knows of a single informal or formal method and uses with 
basic competency. 



4 = I&iows of a variety of methods and uses 1 or more with 
high proficiency. 



AREA 
Behavior 

Auditory Perception 

Visual Perception 

Motor Development 

Language 

Memory 

Cognitive 

Reading 

Math 

Spelling 



1 
1 
1 
1 
1 
1 
1 
1 
1 



FORMAL 

2 3 4 

2 3 4 

2 3 * 

3 4 

3 4 

3 4' 

3 * 

3 *" 

3 * 

3 4 



INFORMAL 



1 
1 
1 
1 
1 
1 



2 
2 
2 
2 
2 
2 
2 



3 4 

3 4 

3 4 

3 J * 

3 4 

3 4 

3 * 



1234 
12 3 4 
1234. 
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TRAINEE'S SELF-RATING OP COMPETENCY (N) 
This form ls a 8elf . ratina device given tQ reguiar Umh ^ 
special teaehera, and support workerfl and can fae admlnlfltered ^ 
to and following their involvement with the project. It was developed 
to a aSeSS changes in the competency areas considered Important for 
the development of programs for learning, disabled and educationally 
handicapped children, The areas covered on the de^oe correspond 
Wlth tho8e ' as ^»^ on Pdrm M - W"^tott^S"i^r^ir""'" 
Regular Teachers, The format of the device consists P f ten items 
covering the areas of assessment techniques, interpretation of assess- 
ment information, developing behavioral objectives, relating objectives 
to assessment information, use of contingency management, skill i„ 
keeping track of student progress, looting resource materials for 
instruction, structuring the learning environment, and sharing the 
responsibilities for instruction. The trainee rates his own skill 
level in each of these previously monitored areas on a four point 
scale that covers the following Anges 1-very little skill, 2-some 
skill, 3-moderate skill, and 4-strong skill. 

The form was used only on a post-training basis in the current 
Project, Mean ratings and standard deviations of ratings were computed 
for each item. If the form is used on a pre . poflt basls di ff erenoe 
scores for each item can be computed as well. Following this, a corre- 
lated T-test would be used to assess the significance of change for 
each of the items. The information on this form can also be related to 
the ratings on Form M, Competency Rating of Special or Regular Teachers, 
in order to determine the relationship between these self-ratings and 
the ratings obtained in the major competency areas by an outside observer. 
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TRAINEE ' S SELF-RATING OF COMPETENCY ( STATUS ) 

Title of person completing form __ L _ _ '■ ■ - 

Date ' 

(PRE - POST - OTHER) ' 

Ins trub tions { 

Please indicate your present level of ability In each of the following 
areas. Circle the response number . 

(1-) VERY LITTLE SKILL (2) SOME SKILL (3) MODERATE SKILL 
(4) STRONG SKILL 

1, DETERMINING LEARNING STRENGTHS AND WEAKNESSES THROUGH FORMAL AND 
INFORMAL ASSESSMENTS 

1 2 3 4 

2, IDENTIFYING LEARNING MODALITIES FOR EACH STUDENT 

i 2 . 3 4 

3, DEVELOPING REALISTIC ACADEMIC BEHAVIORAL OBJECTIVES 

1 2 3 4 

4« RELATING STUDENT INSTRUCTIONAL PROGRAMS TO ASSESSMENT INFORMATION 
1 2 J 4 

5« UTILIZDIG EFFECTIVE TECHNIQUES FOR BEHAVIOR MANAGEMENT 

1 2 3 4 

6. KEEPING TRACK OF STUDENT PROGRESS 

12 3 4 

7- LOCATING AND UTILIZED MATERIALS APPROPRIATE TO YOUR NEEDS. 

1 2 3 4 

8. LOCATING AND UTILIZDTO RESOURCE PERSONNEL APPROPRIATE TO YOUR NEEDS. 

1 2 3 4 

9. STRUCTURING TOE CLASSROOM ENVIRONMENT TO FACILITATE THE USE OF 
RESOURCE MATERIALS IN THE INDIVIDUALIZATION OF INSTRUCTION 

123 4 ' 

10. DEVELOPING THE SHARING OF RESPONSIBILITIES WITH OTHER SCHOOL PER- 
SONNEL DJ MEETING TOE NEEDS OF LEARNING DISABILITY STUDENTS. 

12 3 4 
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TRAINEE'S SffiF-RATING OP CO^ffETENCY CHANGE (0) 

This form is a self* rating device given to the regular teachers, 
special teachers, and support workers following their involvement 
with the project. It was developed to assess the degree of skill 
improvement each of the trainee's perceived had oeoured during 
their project contact, The items are exactly the same as those 
rated on Form N - Trainee's Self-Rating of Competency, The format 
consists of these same ten items but the rating scale used is 
different. The ratings cover a h point scale ranging from 1-very 
little change, 2-some change t 3-moderate change, and 4*large change, 

The form was used on a post- training basis in the current pro- 
ject, Mean change ratings and standard deviations of change ratings 
were computed for each item, The data from this form were compared 
with the data from Form N to determine the relationship between the 
degree of change on each item and the level of competency perceived 
by each trainee on each item. This was done by grouping the trainee 
ratings, item by item, on both forms computing correlations, 
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TRAINEE 1 S 5BLP>RATIN0 OF COMPETENCY CHANGE (POST ONLY) 
Title of person completing form ______ -B=-Ha _ ™_ ^^^^ ^ 

Date ^^^.^^ ...^^^^ _ _ -IP __ WW(-B 
Instructions? 

Please indicate the effectiveness of this yea^s Title VI Project staff 
in. increasing your knowledge or proficiency in each of the following 
areas . 0 ircle the r espons e _number . 

(1) TORY LITTIJ) CHANGE (2) SOfffi CHANGE (3) MODERATE CHANGE (4) LARGE 
CHANGE 

1* DETERMINING LEARNING STRENGTHS AND WEAKNESSES THROUGH FORMAL AND 
DJFOHtfAL ASSESSMENTS 

1 2 3 h 

2, IBffl3TIFYING LEARNED MODALITIES FOR EACH STUB^JT 

1 2 J 4 

3, BEVELDFINO REALISTIC ACADEMIC BEHAVIORAL OBJECTIVES 

1 2 3 4 

4, RELATING STUDENT INSTRUCTIONAL PROGRAMS TO ASSESSMS^T INFORMATION 

12 3 4 

5, UTILIZDTG EFFECTIVE TECHNIQUES FOR SAVIOR MANAOmENT 

12 3 4 

6, IffiBPING ^lACK OF STUDOTT PROGRESS 

12 3 4 

7* LOCATING AND UTILIZING RESOURCE PERSONNEL APPROPRIATE TO YOUR 
NEEDS 

4 1 2 3 4 

8 9 LOCATING AND UTILIZING RESOURCE MATERIALS APPROPRIATE TO YOUR 
NEEDS 

I234 

9. STRUCTURING TFffi CLASSROOM ENVIRGN»iT TO FACILITATE TIffi USE OF 
RESOURCE MATERIALS IN Tfffi INDIVIDUALIZATION OF INSTRUCTION 

1.2 3 4 

10. DEVELOPING THE SHARING OF RESPONSIBILITIES WITH OTHER SCHOOL PER- 
SONNEL m meetbjg the needs of learnbjg disability students 

■ 1 - 2 3 4 
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XNTORVENTION CHECKLIST FOR SPECIAL TEACHERS (P) 



This form was utilized by the trainee's to assess the utility of 
the specific intervention procedures that were presented to them by 
the project staff* Each of the items represents a specific assessment 
device, instructional approach, reinforcement technique t instructional 
material, or teaching strategy. There are 21 items on the form with 
additional space to add items that the trainee's wished to add, " The 
additional items would be those that were introduced through the pro- 
ject only to specific trainee's because of their own individual needs. 
Each item was rated by the trainee on a 4*point scale. The ratings 
are not continuous but do represent mutually exclusive evaluations 
for each item presented* The scale is as follows* 

1- you used the item prior to Title VI intervention 

2- the item is not appropriate to your teaching situation 

3- you need more help for competency in use 

4- your understanding of the item was furthered by Title VI 
and you will use* 

5- you have mastered the item and are now using 

This form was administered on a post training basis in the 
current project. The* percentage of responses, in each category, for 
each item was determined, 
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INTERVENTION CHECKLIST FOR SPECIAL TBACfffiR 

Instructions i Please rate each of the following activities, approaches 
or interventions listed below* We are interested in determing which 
portions of your Title VI involvement have been most useful to you. 
Place a number in front of each item to indicate i 

1 That you used item prior to Title VI intervention 

2 That the item is not appropriate *to your teaching situation 
5 That you feel you need more help for competency in use 

4 That your understanding of item was furthered by Title VI 
and you will use 

5 That you have mastered the item and are now using 

1* Behavior management techniques 

2* Academic contracts 

5* Behavior contracts 
— _ 4* Learning centers 
=a=& 5* Multi-level learning materials 

6* Teaoher-made games 

______ 7* Materials from the resource center 

_____ 8, Individualised instruction 

________ 9* Informal diagnosis of learning styles 

10. Writing academic and behavioral objectives 



11. Rated assessment forms 



12, Regular staff as a resource 



13. Self-concept inventory 



Ik* Techniques for utilizing work samples 



15* Behavior observation techniques 



JL6 # Anabell Markoff inventory 
17. Language Masters 



♦ 522 



3m 



l8. Wide Range Achievement Teat 
19- Gilmore Oral Reading Test 

20. Siingerland 

21. Developmental Learning Material 

22. Task and Behavior Analysis 



SCIEBULE FOR JOTEKVXIWDra SPECIAL OR REGULAR TEACiffiRS (ft) 

This form consists of only three items and is designed for 
a 15 to 20 minute administration, The questions are quite broad 
in nature, and are intended to elicit a variety of responses from 
teachers. Because of the lack of specificity of the items, except 
for question 2, the verbal data elicited are not easily summarised. 
However, through the creative use of content analysis it is 
possible to quantify the data in a number of ways, and to utilise 
statistical tests to determine whether there are differences between 
schools, grade levels, types of teaoherS| etc, (See section ^*1 
of the report for specific examples of data analysis.) 



524 



CALIFORNIA TITLE VI 1 /G PROJECT 
PUBLIC SCHOOL MODEL SERVICE CENTER 



SCHEDULE FOR INTERVIEWING' SPECIAL OR REGULAR TEACHERS 



1. What is your perception of the role of the Title VI-G Project 
as it relates to your school? 



2* What kinds of help did you receive during the past year from 
the Title VI-G Project? 



After initial response, probe these specific categories i 

1, teacher consultation 

2, student instruction 

3, classroom management 

4, curriculum 

5* inserviee training 



3* Please give me your opinion of the effectiveness of the Title VT-G 
Project during the past year by indicating some of its strengths 
and weaknesses* 
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INTERV®JTION CHECKLIST FOR REGULAR imCHERS (R) 

This form was utilized by the trainee's to assess the utility of 
the specific intervention procedures that were presented to them by 
the project staff* Each of tha items represents a specific assess- 
ment device, instructional approach, reinforcement technique, in- 
structional material, or teaching strategy. There are 21 items on 
the form with additional space to add items ^ wished 
to add* The additional items would be those that were introduced 
through -the project only to specific trainee's because of their own 
individual needs. Each item was rated by the trainee on a 4-point 
scale* The ratings are not continuous but do represent mutually 
exclusive evaluations for each item presented, The scale is as 
follows : 

1- you used the item prior to Title VI intervention 

2- the item is not appropriate to your teaching situation 

3- you need more help for competency in use 

4- your understanding of the item was furthered by Title VI 
and you will use again 

5- you have mastered the item and are now using 

This form was administered on a post training basis in the 
current project. The percentage of responses, in each category, 
for each item was determined, 
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DiTTOVro3TION3 CHECKLIST for regular teachers 

Instructions % Please rate each of the following activities, approaches 
or interventions listed below. We are interested in determining which 
portions of the Title VI involvement has been most useful to you, Plae 
a number in front of each item to indicates 

1 That you used item prior to Title VI intervention 

2 That the item is not appropriate to your teaching situation 

3 That you feel you need more help for competency in use 

4 That your understanding of item was furthered by Title VI 
and you will use 

5 That you have mastered the item and are now using 



1. 


Behavior management techniques 


2. 


Academic contracts 




Behavior contracts 


m 4. 


Learning centers 




Multi* level learning materials 


6. 


Teacher*made games 


7. 


Materials from the resource center 


8, 


Individualized instruction 


9. 


Informal diagnosis of learning styles 


10, 


Writing academic and behavioral objectives 


11, 


Rated Assessment forms 


12, 


Regular staff as a resource 


13. 


Self-concept inventory 


14. 


Techniques for utilizing work samples 


15* 


Behavior observation techniques 


16. 


Anabell Markoff inventory 


17. 


Language Masters 
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_XS* Wide Range Achievement Teat 
19* tjilmore Oral Reading Test 

>* Slingeriand 
^21 s Developmental Learning Material 
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SCHEDULE FOR INTERVIEWDJG SCHOOL ADMINISTRATORS (S) 



This form consists of four items and is designed for a 15 to 
20 minute administration* The form is quite similar to Form Q, the 
interview schedule for teachers, The questions are quite broad in 
nature, except for question 5, and are intended to elicit a variety 
of responses from administrators, Because of the lack of specificity 
of the items , the verbal data elicited are not easily summarised, 
However, through the use of content analysis, it is possible to 
quantify the data in a number of ways, and to utilize statistical 
tests if desired to probe differences between schools and within 
schools, (See section 4,1 of the report for specific examples of 
data analysis). 



s 
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scheduxjl tor rormwimmro school aotoiistrators 



What is your perception of the role of the Title VT-G Project 
as it relates to your school? 



What kinds of help did you receive during the past year from 
Title VI-G Projeot? 



After initial response f probe these specific categories: 

1. teacher consultation 

2. student instruction 
3* classroom management 
4 , curriculum 

5* inservloe training 



To the best of your knowledge have added funds or space been 
allocated to your EH or LOG program since involvement with 
Title VI-G? 



Please give me your opinion of the effectiveness of the Title VI-G 
Project during the past year by indicating some of its strengths 
and weaknesses. 
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COLLEGE/UNIVERSITY STUDENT IN TRAINING 
ACTIVITIES QUESTIONNAIRE (T) 

This instrument was developed originally by the project 
director during the second year, After being administered to a 
group of interns at the end of that year it was revised by the 
evaluators to include additional information, and to provide for 
ease of scoring and statistical analysis, 

The first part of the form requires the respondent to indicate 
his type of involvement and his overall feeling about the amount of 
time spent - too long, adequate, or too short. If a reasonable number 
of students were involved as trainees, these data could be analyzed in 
the form of a two-way chi-square contingency table with type of affilia- 
tion as one variable and time spent as the other, other non-para- 
metric tests are possible, as well, but most likely this information 
would be used mainly to classify students into various groups for 
purposes of analyzing other parts of the questionnaire, 

The second part of the instrument is an activities checklist. 
The purpose of this section is to find out exactly what experiences a ' 
trainee had during his internship experience. Frequency counts can 
be made for all respondents in order to determine which activities 
received greatest emphasis. Or, as alluded to above, comparisons in 
frequencies could be made across the affiliation categories listed 
in the first section of the instrument. Again, non-parametric 
analysis, such as chi-square would be appropriate, since the data are 
in the form of raw frequency counts. 

The third section of the report, "Rating of Internship 
Experience," is really the heart of the instrument. This section 
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contains 10 items which elicit responses on continuous 4*point scales. 
Thus p for analysis purposes, one might compute means and standard 
deviations for individual items. This would allow the statistical 
comparison of various groups of respondents, such as paid substitute 
vs. volunteer trainees on aiiy number of items using the t-statistic * 
Multiple groups of trainees could be compared using an appropriate 
analysis-of- variance model, provided the necessary assumptions for 
the data could be met* 

Another possible procedure for analyzing the data might be 
the computation of an intercorrelation matrix for the 10 items* 
Such a matrix of coefficients of correlation would provide informa- 
tion on the relationships between item responses. One important 
question which this technique would help to answer would be fr What 
aspects of the internahip experience (items 1-8) are significantly 
related to a positive (or negative) overall experience (item 9)? 
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CQII^GE/UNIVERSITY 3TUDTOP-D? TRAINING ACTIVITIES QUESTIONNAIRE 

Nam e Date _ == __ e _ ss 

(leave blank if you prefer) ~~ 

College L evel _ =te _ ===6 _^_^_ 

(junior, graduate, etc , ) 

TYPE OP IWOLVaCTT WITH TITLE VI-G PROJECT t 

Number of days per week ^^^^^^^^^^^^^ 
Number of months per year 

Nature of project affiliation (check one below) 

College credit 

Volunteer basis 

Paid substitute 
— — _ Combination paid and volunteer 
Combination paid and college credit 

GENERALLY, HOW DO YOU FEEL ABOUT TTffi AMOUNT OP TBE YOU HAVE SPm? WITH 
TITLE VI IN TERMS OP DEVELOPOTO YOUR COMPETENCIES? 

Too long 
ai _^_ Adequate 
Too short 

ACTIVITIES CHECKLIST 

Please check those activities below which you have engaged in during your 
internship at Title VI* 

1. Qbse'rved staff working directly with students* 
_____ 2, Assisted staff working with students, 

3» Cooperated with staff in planning lessons for students, 
4, Independently planned and carried out lessons, 
5* Observed students being evaluated, 

6* Assisted in administering and scoring formal and informal 

assessment techniques. 
7* Independently administered and scored standardized tests, 

8. Used commercial and projects-developed curriculum 

materials in instruction, 

9* Independently created teaching materials to meet specific 

needs of students • 

10, Used coOTnercial and project-developed curriculum 
materials in instruction, 

11. Independently created teaching materials to meet 
specific needs of students* 

— 12, Assisted in conducting a workshop for a group of teachers* 
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13. Conducted a section of a workshop, 
" 14. Worked with students having learning difficulties in 

their regular classroom* 
==i ^ 15* Worked with students in special classes. 

16* Met with social worker, psychologist, or other 
specialist concerning students, 

RATING OF PTORN3HIP EXPERIENCE 

Please circle the appropriate response* 

1. The praetioum experience has related to my college eoursewerk* 

1 . Greatly 

2, Fairly often 

3. Rarely 

4* Not at all 

2. I have had the opportunity to work with students and teachers 
in professional tasks* 

1 , Consistently 

2, Fairly often 
3* Inconsistently 

4, Never 

3* Title VI staff have been available to work and plan with: 

1. Whenever necessary 

2* Fairly often 

3* Inconsistently 

4, Hardly ever 

4, The variety of experiences offered have been 

1* Challenging and many 

2* Challenging and few 

3, Boring and many 
4* Boring and few 

5# The opportunity to work independently and assume responsibility 
has been provided 

1, Quite often 

2. Fairly often 
3* Seldom 

4* Never 
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My experience in relation to assessing individual student f s 
needs have resulted in n§r being 



l t Confidant of my skills 

2, Confident but needing more practice 

3, Somewhat unsure of ray abilities 

4* Very uncomfortable in this situation 

7. My escperienoe in relation to teaching students with learning 
difficulties have resulted in my being 

1, Confident in my skills 

2* Confident but needing more practise 
5» Somewhat unsure of my abilities 

4, Uncomfortable in this situation 

8* My experience in relation to teaching students with behavior 
difficulties have resulted in ray being 

1* Confident in my skills 

2, Confident but needing more practice 
3* Somewhat unsure of abilties 

k m Uncomfortable 

9* My overall rating of the Title VI internship esqperience is 

1 # Outstanding 

2. Worthwhile 

3. Less than optimal 

4. A waste l of; time 

10* My experience included opportunities to serve regular and special 
children in the following proportions 1 



Regular EH 

1. 1QS* 90^ 

2. 3051 70% 

3. 70J* J®% 

4. 90^ 10$ 



COMMENTS t Please write below any reactions you have to your intern- 
ship which were, perhaps, not assessed by this questionnaire, Focus 
on both good Mid bad escperienoes, and make recotranendations for improve 
ments - 
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